00000001:02000400:2.0F:1789776256.451735:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789776273.510563:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789776275.114260:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 967 MB/s 00000001:01000000:3.0:1789776275.364313:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1235 MB/s 00000001:01000000:0.0F:1789776275.614100:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3695 MB/s 00000020:02000000:2.0:1789776276.385737:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_111_g8cb7ca1 00000400:02000000:3.0:1789776277.033406:0:3627:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.127@tcp [8/256/0/180] 00008000:02000000:0.0:1789776280.661048:0:3776:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789776339.572486:0:5744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789776350.494890:0:6493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789776350.494898:0:6493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789776350.494900:0:6493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789776350.495043:0:6493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000025b937e3 00000080:02000400:1.0:1789776350.495055:0:6493:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789776350.502725:0:6493:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789776350.502741:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789776350.502807:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000f253c4c) 00000020:00000080:1.0:1789776350.502828:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789776350.567311:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789776350.567386:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789776350.610202:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789776350.610456:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789776350.610465:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789776350.610476:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb884494 00000020:01000004:0.0:1789776350.610483:0:6493:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789776350.610488:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789776350.610582:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025b937e3 from MGS 00000020:01000004:0.0:1789776350.610587:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789776350.610606:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000075fd59f6) 00000020:00000080:0.0:1789776350.610618:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789776350.610729:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025b937e3 from MGS, refs=2 00080000:01000000:0.0:1789776350.610735:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789776350.610740:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb8844a2 00000100:00100000:0.0:1789776350.610841:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789776350.612167:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789776350.612173:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789776350.613344:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789776350.613352:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789776350.618209:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776350.618467:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789776350.618473:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789776350.620789:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789776350.620807:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789776350.621664:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789776350.621673:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789776350.624252:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776350.624257:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776350.624260:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776350.624687:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776350.624690:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776350.624691:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776350.628100:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789776350.629988:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789776350.875618:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3539 MB/s 00000001:01000000:3.0:1789776351.127562:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4706 MB/s 00000001:01000000:2.0:1789776351.379127:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 509 MB/s 00000001:01000000:3.0:1789776351.628824:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 631 MB/s 00080000:10000000:3.0:1789776351.637776:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789776351.647806:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:1.0:1789776351.651043:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789776351.652330:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789776351.653121:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789776351.653174:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789776351.653377:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789776351.653410:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789776351.656282:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776351.656550:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789776351.656557:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789776351.664639:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789776351.664656:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789776351.670921:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789776351.670940:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789776351.671708:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789776351.671732:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:3.0:1789776351.671733:0:6493:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789776351.671787:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:3.0:1789776351.671805:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (00000000dc54823d) 00000020:00000080:3.0:1789776351.671821:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789776351.671948:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000434fdd7f@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1789776351.672100:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:3.0:1789776351.672106:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789776351.673670:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789776351.683545:0:6514:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789776351.683655:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72) 00000020:00000080:1.0:1789776351.683679:0:6493:0:(genops.c:1385:class_connect()) connect: client fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72, cookie 0xf13b8042cb8844b0 00000100:00080000:1.0:1789776351.683691:0:6493:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776351.683695:0:6493:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import 00000000434fdd7f using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776351.683736:0:6493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a85b9899 x1876716449431680/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776351.683762:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS 00000020:01000004:1.0:1789776351.683777:0:6493:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789776351.683781:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789776351.683793:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000066502e5f) 00000020:00000080:1.0:1789776351.683804:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789776351.684043:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a85b9899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449431680:0@lo:250: 00000100:00100000:0.0:1789776351.684092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776351.684149:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449431680 00000100:00100000:2.0:1789776351.684156:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449431680 00000100:00100000:2.0:1789776351.684192:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776351.684198:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037691507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876716449431680:12345-0@lo:250: 00010000:00080000:2.0:1789776351.684220:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1789776351.684239:0:6509:0:(genops.c:1385:class_connect()) connect: client fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72, cookie 0xf13b8042cb8844be 00000100:00080000:2.0:1789776351.684367:0:6509:0:(import.c:65:import_set_state_nolock()) 000000003834bb14 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776351.684446:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037691507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:3642:x1876716449431680:12345-0@lo:250: Request processed in 246us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776351.684454:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776351.684563:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789776351.684572:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1789776351.684579:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789776351.684582:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789776351.684585:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000434fdd7f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789776351.684588:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789776351.684612:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789776351.684620:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a85b9899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449431680:0@lo:250: 00000100:00100000:1.0:1789776351.699004:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776351.699238:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789776351.699249:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789776351.699965:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789776351.699974:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789776351.700350:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789776351.700356:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789776351.701184:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776351.701399:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789776351.701641:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789776351.705434:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789776351.705447:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789776351.769239:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776351.769773:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789776351.769782:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789776351.770949:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789776351.770961:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789776351.771827:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776351.772046:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789776351.772051:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789776351.772705:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789776351.772713:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789776351.773235:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776351.773421:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789776351.773427:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789776351.774251:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789776351.774259:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789776351.775158:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776351.775383:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789776351.775388:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789776351.776089:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789776351.776096:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789776351.804658:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776351.804916:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789776351.804923:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789776351.806608:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789776351.806619:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789776351.807657:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789776351.807666:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789776351.808774:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789776351.808805:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789776351.808813:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789776351.808936:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789776351.808979:0:6493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789776351.808984:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789776351.809065:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776351.809067:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776351.809068:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776351.809070:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776351.809071:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776351.809072:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776351.809074:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776351.809075:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776351.809076:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776351.809078:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776351.809079:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789776351.809082:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789776351.809084:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776351.809085:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776351.809086:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776351.809087:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776351.809094:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776351.809095:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776351.809096:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776351.809096:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776351.809097:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776351.809098:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776351.809099:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776351.809100:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789776351.809135:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789776351.809153:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b0f7737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449431808:0@lo:253: 00000100:00100000:0.0:1789776351.809229:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776351.809343:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d862cfa going to sleep for 11 seconds 00000100:00100000:1.0:1789776351.809608:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449431808 00000100:00100000:1.0:1789776351.809616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449431808 00000100:00100000:1.0:1789776351.809696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776351.809705:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db89d03a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6493:x1876716449431808:12345-0@lo:253: 20000000:01000000:1.0:1789776351.809749:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789776351.809752:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789776351.810161:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789776351.810202:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789776351.811259:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776351.817778:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789776351.818237:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789776351.818242:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789776351.818248:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789776351.818251:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789776351.818264:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789776351.818905:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776351.819178:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789776351.819200:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789776351.819218:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789776351.819231:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789776351.819244:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789776351.819297:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789776351.819304:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789776351.819314:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789776351.819319:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789776351.819329:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789776351.819333:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789776351.819343:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789776351.819354:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789776351.819377:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789776351.819380:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789776351.819387:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776351.819863:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789776351.819875:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789776351.819891:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789776351.819903:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789776351.819930:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789776351.819954:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789776351.819981:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789776351.820167:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789776351.820186:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789776351.820202:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789776351.820215:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789776351.820223:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789776351.820244:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789776351.820253:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789776351.820263:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789776351.820275:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789776351.820333:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789776351.820359:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789776351.820365:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789776351.821936:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789776351.822813:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789776351.822844:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:2.0:1789776351.822846:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:2.0:1789776351.822863:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789776351.822869:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789776351.822882:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789776351.822888:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:2.0:1789776351.822900:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789776351.822907:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789776351.822918:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789776351.822932:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789776351.822970:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789776351.822973:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789776351.822977:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789776351.823341:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789776351.823344:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789776351.824194:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789776351.824415:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789776351.824905:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789776351.824945:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789776351.824958:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789776351.824960:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789776351.826631:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789776351.827262:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789776351.827292:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789776351.827307:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789776351.827319:0:6511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789776351.827322:0:6511:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789776351.827328:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789776351.827330:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789776351.827336:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789776351.827355:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789776351.828269:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789776351.828419:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789776351.840697:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789776351.840741:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789776351.840757:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789776351.840788:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789776351.840809:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840826:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840837:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840842:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840848:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840854:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840858:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd32a88f already unused, calling callback (000000004c80d481) 00010000:00010000:3.0:1789776351.840862:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840869:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840895:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840902:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776351.840908:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd32a88f/0xf13b8042cb8844c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789776351.840927:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789776351.850101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db89d03a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6493:x1876716449431808:12345-0@lo:253: Request processed in 40389us (40864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776351.850121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776351.850309:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b0f7737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449431808:0@lo:253: 10000000:01000000:1.0:1789776351.850326:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789776351.850329:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776351.850331:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776351.850333:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776351.850334:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789776351.850335:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776351.850337:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776351.850338:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776351.850347:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776351.850349:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789776351.850350:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776351.850351:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789776351.850373:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025b937e3 from lustre-MDT0000 10000000:01000000:1.0:1789776351.850417:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789776351.850420:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789776351.850425:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a5cc8c63370 10000000:01000000:1.0:1789776351.850428:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776351.850437:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5cc8c63370 from 1 10000000:01000000:1.0:1789776351.850439:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789776351.850477:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.850488:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.850530:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776351.850549:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f68f777 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449431936:0@lo:101: 00000100:00100000:1.0:1789776351.850606:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776351.850649:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a527fc3 going to sleep for 11 seconds 00000100:00100000:2.0:1789776351.850708:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449431936 00000100:00100000:2.0:1789776351.850715:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449431936 00000100:00100000:2.0:1789776351.850758:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776351.850766:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9e3385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6493:x1876716449431936:12345-0@lo:101: 00010000:00010000:2.0:1789776351.850778:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776351.850792:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8844cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.850815:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.850824:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.850832:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae736fcb, rc 0) 00000100:00100000:2.0:1789776351.850876:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9e3385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6493:x1876716449431936:12345-0@lo:101: Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776351.850882:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776351.850948:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f68f777 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449431936:0@lo:101: 00010000:00010000:1.0:1789776351.850960:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.850968:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776351.851024:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f68f777 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432064:0@lo:501: 00000100:00100000:1.0:1789776351.851052:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776351.851074:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a527fc3 going to sleep for 11 seconds 00000100:00100000:2.0:1789776351.851115:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432064 00000100:00100000:2.0:1789776351.851119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432064 00000100:00100000:2.0:1789776351.851144:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776351.851150:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001de80dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6493:x1876716449432064:12345-0@lo:501: 00000100:00100000:2.0:1789776351.851229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001de80dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6493:x1876716449432064:12345-0@lo:501: Request processed in 79us (176us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776351.851235:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776351.857796:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f68f777 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432064:0@lo:501: 10000000:01000000:0.0:1789776351.857859:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789776351.857882:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.857894:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776351.857903:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5cdb443800 10000000:01000000:0.0:1789776351.857911:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789776351.857917:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a5cdb443800 10000000:01000000:0.0:1789776351.857920:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789776351.857923:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a5cdb443800 from 1 10000000:01000000:0.0:1789776351.857925:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789776351.857965:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.857973:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.857982:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776351.858018:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432192:0@lo:101: 00000100:00100000:0.0:1789776351.858084:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776351.858132:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432192 00000100:00100000:0.0:1789776351.858139:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432192 00000100:00100000:0.0:1789776351.858188:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776351.858197:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a064bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6493:x1876716449432192:12345-0@lo:101: 00010000:00010000:0.0:1789776351.858213:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776351.858232:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa7b0ac7/0xf13b8042cb8844e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8844da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858256:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa7b0ac7/0xf13b8042cb8844e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8844da expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858266:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa7b0ac7/0xf13b8042cb8844e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8844da expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858274:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa7b0ac7, rc 0) 00000100:00100000:0.0:1789776351.858306:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a064bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:6493:x1876716449432192:12345-0@lo:101: Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776351.858312:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776351.858356:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afbd5527 going to sleep for 11 seconds 00000100:00100000:0.0:1789776351.858371:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432192:0@lo:101: 00010000:00010000:0.0:1789776351.858381:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858388:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776351.858423:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789776351.858426:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858431:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bd629138/0xf13b8042cb8844da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776351.858437:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789776351.858440:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776351.858444:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a5cdb443800 10000000:01000000:0.0:1789776351.858446:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789776351.858449:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789776351.858451:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776351.858463:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858469:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858475:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776351.858485:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432320:0@lo:101: 00000100:00100000:0.0:1789776351.858538:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776351.858755:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432320 00000100:00100000:0.0:1789776351.858760:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432320 00000100:00100000:0.0:1789776351.858796:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776351.858802:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4955db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:6493:x1876716449432320:12345-0@lo:101: 00010000:00010000:0.0:1789776351.858819:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776351.858827:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8844e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858841:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858849:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858856:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ba3177a, rc 0) 00000100:00100000:0.0:1789776351.858882:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4955db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:6493:x1876716449432320:12345-0@lo:101: Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776351.858888:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776351.858917:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afbd5527 going to sleep for 11 seconds 00000100:00100000:0.0:1789776351.858932:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432320:0@lo:101: 00010000:00010000:0.0:1789776351.858941:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776351.858947:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776351.859011:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432448:0@lo:501: 00000100:00100000:0.0:1789776351.859037:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776351.859061:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afbd5527 going to sleep for 11 seconds 00000100:00100000:3.0:1789776351.859213:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432448 00000100:00100000:3.0:1789776351.859218:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432448 00000100:00100000:3.0:1789776351.859250:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776351.859257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061a9e386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:6493:x1876716449432448:12345-0@lo:501: 00000100:00100000:3.0:1789776351.859365:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061a9e386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6493:x1876716449432448:12345-0@lo:501: Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776351.859372:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789776351.859827:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432448:0@lo:501: 00000100:00100000:0.0:1789776351.859860:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432576:0@lo:503: 00000100:00100000:0.0:1789776351.859907:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776351.859967:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afbd5527 going to sleep for 11 seconds 00000100:00100000:3.0:1789776351.864423:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432576 00000100:00100000:3.0:1789776351.864440:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432576 00000100:00100000:3.0:1789776351.864610:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776351.864622:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037c72841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6493:x1876716449432576:12345-0@lo:503: 00000100:00100000:3.0:1789776351.865163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037c72841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6493:x1876716449432576:12345-0@lo:503: Request processed in 541us (5253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776351.865172:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776351.865393:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432576:0@lo:503: 00000100:00100000:2.0:1789776351.866705:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6538:1876716449432704:0@lo:502: 00000100:00100000:2.0:1789776351.866783:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776351.866857:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039fb4ffa going to sleep for 11 seconds 00000100:00100000:0.0:1789776351.867904:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432704 00000100:00100000:0.0:1789776351.867915:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432704 00000100:00100000:0.0:1789776351.867980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776351.868000:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff45c054 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6538:x1876716449432704:12345-0@lo:502: 00000100:00100000:0.0:1789776351.868164:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff45c054 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6538:x1876716449432704:12345-0@lo:502: Request processed in 166us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776351.868173:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776351.868208:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6538:1876716449432704:0@lo:502: 00000020:01000000:2.0:1789776351.868239:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776351.868249:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776351.868252:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789776351.868256:0:6538:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789776351.868258:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776351.868279:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003ade5961) 00000020:00000080:2.0:1789776351.868297:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789776351.868304:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789776351.868381:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789776351.868387:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb8844fd 00000020:00000080:2.0:1789776351.868958:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789776351.868964:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776351.868968:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776351.868970:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789776351.868972:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776351.868976:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776351.868977:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789776351.868980:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776351.868986:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000234eee00) 00000020:00000080:2.0:1789776351.868997:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789776351.869001:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789776351.869002:0:6538:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789776351.869005:0:6538:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789776351.869011:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789776351.869170:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025b937e3 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789776351.869183:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001d88636b) 00000020:00000080:2.0:1789776351.869192:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789776351.869266:0:6538:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789776351.869278:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb884512 00000020:00000080:2.0:1789776351.869412:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789776351.869419:0:6538:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789776351.869423:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf13b8042cb884519 00080000:01000000:2.0:1789776351.871224:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789776351.871258:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb884520 00080000:10000000:2.0:1789776351.873136:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789776351.873377:0:6538:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789776351.879842:0:6538:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789776351.960693:0:6538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789776351.961111:0:6538:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789776351.964099:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789776351.964555:0:6538:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789776351.967383:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000bfb802d) 00000020:00000080:2.0:1789776351.967419:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789776351.967542:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789776351.967551:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb88452e 00000020:00000080:2.0:1789776351.972140:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789776351.973714:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789776351.978805:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789776351.982025:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789776351.984780:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789776351.988161:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789776351.990222:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789776351.992283:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf13b8042cb884535 00000020:00000080:3.0:1789776351.993197:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789776351.993208:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776351.993215:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776351.993217:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789776351.993221:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776351.993225:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776351.993226:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776351.993230:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776351.993231:0:6538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789776351.993234:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776351.993236:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776351.993238:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789776351.993240:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776351.993244:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776351.993245:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789776351.993249:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789776351.993289:0:6538:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789776351.993357:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a29124b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6538:1876716449432832:0@lo:502: 00000100:00100000:3.0:1789776351.993451:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776351.993535:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8d8b556 going to sleep for 11 seconds 00000100:00100000:2.0:1789776351.993663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432832 00000100:00100000:2.0:1789776351.993672:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432832 00000100:00100000:2.0:1789776351.993722:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776351.993731:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a33ee55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6538:x1876716449432832:12345-0@lo:502: 00000100:00100000:2.0:1789776351.993840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a33ee55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6538:x1876716449432832:12345-0@lo:502: Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776351.993848:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776351.994128:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a29124b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6538:1876716449432832:0@lo:502: 00000020:01000000:3.0:1789776351.994156:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776351.994161:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776351.994163:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789776351.994166:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789776351.994314:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789776351.994338:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789776351.994360:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.994370:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776351.994378:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cdb443800 from 1 10000000:01000000:1.0:1789776351.994380:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776351.994416:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.994424:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.994432:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776351.994446:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432960:0@lo:101: 00000100:00100000:1.0:1789776351.994481:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776351.994538:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 00000100:00100000:2.0:1789776351.994717:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449432960 00000100:00100000:2.0:1789776351.994723:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449432960 00000100:00100000:2.0:1789776351.994758:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776351.994765:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d0bfa0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6493:x1876716449432960:12345-0@lo:101: 00010000:00010000:2.0:1789776351.994775:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776351.994788:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88453c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.994808:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88453c expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.994819:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88453c expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776351.994827:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9c365d4, rc 0) 00000100:00100000:2.0:1789776351.994858:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d0bfa0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:6493:x1876716449432960:12345-0@lo:101: Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776351.995166:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449432960:0@lo:101: 00010000:00010000:1.0:1789776351.995180:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.995188:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776351.996010:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433088:0@lo:256: 00000100:00100000:1.0:1789776351.996060:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776351.996134:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 00000100:00100000:2.0:1789776351.996223:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776351.996357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433088 00000100:00100000:0.0:1789776351.996364:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433088 00000100:00100000:3.0:1789776351.996421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776351.996430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0282a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:6493:x1876716449433088:12345-0@lo:256: 20000000:01000000:3.0:1789776351.996447:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789776351.996459:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789776351.996712:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0282a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:6493:x1876716449433088:12345-0@lo:256: Request processed in 283us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776351.996720:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776351.996787:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433088:0@lo:256: 10000000:01000000:1.0:1789776351.997416:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776351.997437:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776351.997447:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776351.997456:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cdb443800 from 1 10000000:01000000:1.0:1789776351.997458:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776351.997484:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.001817:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.001840:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776352.001870:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433216:0@lo:101: 00000100:00100000:1.0:1789776352.002020:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776352.002063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433216 00000100:00100000:3.0:1789776352.002072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433216 00000100:00100000:1.0:1789776352.002080:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789776352.002121:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776352.002129:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2803b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:6493:x1876716449433216:12345-0@lo:101: 00010000:00010000:3.0:1789776352.002142:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776352.002163:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88454a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.002191:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88454a expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.002200:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88454a expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.002208:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd32a88f, rc 0) 00000100:00100000:3.0:1789776352.002255:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2803b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433216:12345-0@lo:101: Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.002261:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776352.002346:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433216:0@lo:101: 00010000:00010000:1.0:1789776352.002360:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.002936:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776352.003011:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433344:0@lo:501: 00000100:00100000:1.0:1789776352.003046:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.003065:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789776352.003109:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433344 00000100:00100000:0.0:1789776352.003114:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433344 00000100:00100000:0.0:1789776352.003148:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776352.003155:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063b4bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433344:12345-0@lo:501: 00000100:00100000:0.0:1789776352.003311:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063b4bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433344:12345-0@lo:501: Request processed in 157us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776352.003319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776352.003447:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433344:0@lo:501: 00000100:00100000:1.0:1789776352.003473:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433472:0@lo:503: 00000100:00100000:1.0:1789776352.003532:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.003592:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789776352.003627:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433472 00000100:00100000:3.0:1789776352.003631:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433472 00000100:00100000:3.0:1789776352.003695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776352.003703:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000281d92d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433472:12345-0@lo:503: 00000040:00080000:3.0:1789776352.003736:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776352.003820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000281d92d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433472:12345-0@lo:503: Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.003836:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776352.003907:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433472:0@lo:503: 00000040:00080000:1.0:1789776352.004802:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789776352.004956:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789776352.004976:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776352.004995:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776352.005006:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776352.005053:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789776352.005064:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5cdb443800 10000000:01000000:0.0:1789776352.005066:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5cdb443800 10000000:01000000:0.0:1789776352.005070:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776352.005076:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cdb443800 from 1 10000000:01000000:0.0:1789776352.005079:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776352.005116:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776352.005124:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776352.005133:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776352.005149:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433600:0@lo:101: 00000100:00100000:0.0:1789776352.005195:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776352.005267:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea5154f5 going to sleep for 11 seconds 00000100:00100000:3.0:1789776352.005304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433600 00000100:00100000:3.0:1789776352.005311:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433600 00000100:00100000:3.0:1789776352.005371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776352.005378:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf5164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6493:x1876716449433600:12345-0@lo:101: 00010000:00010000:3.0:1789776352.005388:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776352.005410:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884558 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.005431:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884558 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.005441:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884558 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.005448:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090b3c1f8, rc 0) 00000100:00100000:3.0:1789776352.005514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf5164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449433600:12345-0@lo:101: Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.005521:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776352.005595:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007585ebee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433600:0@lo:101: 00010000:00010000:1.0:1789776352.005608:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.005615:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776352.005658:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433728:0@lo:501: 00000100:00100000:1.0:1789776352.005686:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.005803:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015654253 going to sleep for 11 seconds 00000100:00100000:0.0:1789776352.005841:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433728 00000100:00100000:0.0:1789776352.005845:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433728 00000100:00100000:0.0:1789776352.005865:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789776352.005871:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006df29186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449433728:12345-0@lo:501: 00000100:00100000:0.0:1789776352.005972:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006df29186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449433728:12345-0@lo:501: Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776352.005978:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789776352.006038:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433728:0@lo:501: 00000100:00100000:1.0:1789776352.006063:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433856:0@lo:503: 00000100:00100000:1.0:1789776352.006106:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.006127:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015654253 going to sleep for 11 seconds 00000100:00100000:0.0:1789776352.006164:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433856 00000100:00100000:0.0:1789776352.006169:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433856 00000100:00100000:0.0:1789776352.006185:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789776352.006189:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020774a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449433856:12345-0@lo:503: 00000100:00100000:0.0:1789776352.006264:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020774a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449433856:12345-0@lo:503: Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776352.006276:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776352.006338:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449433856:0@lo:503: 00000100:00100000:1.0:1789776352.006706:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6543:1876716449433984:0@lo:502: 00000100:00100000:1.0:1789776352.006743:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.006774:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c770e2f5 going to sleep for 11 seconds 00000100:00100000:0.0:1789776352.006813:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449433984 00000100:00100000:0.0:1789776352.006818:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449433984 00000100:00100000:0.0:1789776352.006848:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776352.006855:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ee15244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6543:x1876716449433984:12345-0@lo:502: 00000100:00100000:0.0:1789776352.006939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ee15244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6543:x1876716449433984:12345-0@lo:502: Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776352.006945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776352.007018:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6543:1876716449433984:0@lo:502: 00000020:01000004:1.0:1789776352.007073:0:6543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789776352.007087:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004430c433) 00000020:00000080:1.0:1789776352.007104:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789776352.007194:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025b937e3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789776352.007198:0:6543:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000025b937e3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789776352.007201:0:6543:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000025b937e3 4 00010000:00080000:1.0:1789776352.007226:0:6543:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000027de0477@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1789776352.009194:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789776352.009456:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789776352.009520:0:6543:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789776352.009532:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf13b8042cb88456d 00000100:00080000:1.0:1789776352.009541:0:6543:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776352.009545:0:6543:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027de0477 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776352.009578:0:6543:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058ec8b21 x1876716449434112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776352.009600:0:6543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789776352.009771:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449434112:0@lo:38: 00000100:00100000:3.0:1789776352.009838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.009934:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434112 00000100:00100000:1.0:1789776352.009941:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434112 00000100:00100000:1.0:1789776352.009987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776352.009993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a29124b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449434112:12345-0@lo:38: 00000100:00100000:1.0:1789776352.010051:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a29124b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449434112:12345-0@lo:38: Request processed in 57us (213us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789776352.010058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776352.010245:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071b71ebf pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6543:1876716449434240:0@lo:502: 00000100:00100000:1.0:1789776352.010286:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.010309:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434240 00000100:00100000:1.0:1789776352.010312:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434240 00000100:00100000:1.0:1789776352.010337:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776352.010341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041fa6238 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6543:x1876716449434240:12345-0@lo:502: 00000100:00100000:1.0:1789776352.010445:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041fa6238 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6543:x1876716449434240:12345-0@lo:502: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776352.010452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776352.010487:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000683f1b62 going to sleep for 11 seconds 00000100:00100000:1.0:1789776352.010528:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071b71ebf pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6543:1876716449434240:0@lo:502: 00000040:00080000:1.0:1789776352.010552:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1789776352.010767:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776352.010773:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000027de0477 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776352.010777:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789776352.010780:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058ec8b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449434112:0@lo:38: 00000020:01000000:1.0:1789776352.011683:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789776352.011706:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776352.011856:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.011946:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789776352.012320:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789776352.012322:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776352.012324:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776352.012325:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776352.012326:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776352.012328:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776352.012331:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776352.012333:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776352.012334:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776352.012335:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776352.012336:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776352.012337:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789776352.012342:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789776352.012344:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776352.012346:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776352.012346:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776352.012347:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776352.012348:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776352.012349:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776352.012350:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776352.012351:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776352.012352:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776352.012353:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776352.012353:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776352.012354:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789776352.012376:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789776352.012405:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071b71ebf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449434368:0@lo:253: 00000100:00100000:1.0:1789776352.012466:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776352.012801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434368 00000100:00100000:2.0:1789776352.012809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434368 00000100:00100000:2.0:1789776352.012859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776352.012867:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befaf03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449434368:12345-0@lo:253: 20000000:01000000:2.0:1789776352.012893:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789776352.012906:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789776352.012980:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a764d5 going to sleep for 11 seconds 20000000:01000000:3.0:1789776352.018166:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789776352.018189:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789776352.018581:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befaf03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6493:x1876716449434368:12345-0@lo:253: Request processed in 5710us (6111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.018594:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:1.0:1789776352.018660:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789776352.018666:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789776352.018690:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.018707:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88453c expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776352.018714:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776352.018721:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071b71ebf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6493:1876716449434368:0@lo:253: 10000000:01000000:2.0:1789776352.018735:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789776352.018738:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789776352.018740:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789776352.018741:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776352.018747:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776352.018748:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776352.018749:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:1.0:1789776352.018749:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789776352.018750:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776352.018752:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789776352.018753:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776352.018755:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776352.018756:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776352.018758:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1789776352.018771:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 11 pid: 6509 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1789776352.018772:0:6493:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789776352.018784:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005687ab92 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449434496:0@lo:104: 00000100:00100000:1.0:1789776352.018817:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776352.018858:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015654253 going to sleep for 11 seconds 00000100:00100000:3.0:1789776352.018867:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434496 00000100:00100000:3.0:1789776352.018874:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434496 00000100:00100000:3.0:1789776352.018915:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776352.018923:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002db0b511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449434496:12345-0@lo:104: 00010000:00010000:3.0:1789776352.018935:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.018983:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776352.018993:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002db0b511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449434496:12345-0@lo:104: Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.018999:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789776352.019017:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776352.019022:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019029:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dde398db already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776352.019032:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019040:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776352.019045:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776352.019050:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776352.019074:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019086:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776352.019105:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019111:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000dde398db/0xf13b8042cb88453c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884543 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019129:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776352.019131:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776352.019132:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776352.019209:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005687ab92 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449434496:0@lo:104: 00010000:00010000:1.0:1789776352.019221:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776352.019597:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f767626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449434624:0@lo:103: 00000100:00100000:0.0:1789776352.019632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776352.019672:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434624 00000100:00100000:3.0:1789776352.019678:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434624 00010000:00010000:3.0:1789776352.019698:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 12 pid: 6509 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776352.019730:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776352.019737:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000924e9434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:3644:x1876716449434624:12345-0@lo:103: 00010000:00010000:3.0:1789776352.019748:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776352.019752:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 12 pid: 6509 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019762:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 12 pid: 6509 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019774:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9c365d4/0xf13b8042cb884543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88453c expref: 12 pid: 6509 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019787:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019804:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789776352.019817:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001152881s 00010000:00010000:3.0:1789776352.019821:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019827:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019833:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019839:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019844:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061867f02 already unused, calling callback (000000004c80d481) 00010000:00010000:3.0:1789776352.019847:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019853:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019877:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776352.019886:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776352.019918:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000924e9434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3644:x1876716449434624:12345-0@lo:103: Request processed in 182us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776352.019925:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776352.019962:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f767626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449434624:0@lo:103: 00010000:00010000:0.0:1789776352.020125:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776352.020133:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776352.020139:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061867f02/0xf13b8042cb884574 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789776352.024213:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.024422:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789776352.024899:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.025057:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789776352.025217:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.025361:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789776352.026148:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.026312:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789776352.026750:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.026953:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789776352.027154:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789776352.027318:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789776352.030205:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789776352.039821:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789776352.039959:0:6548:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789776352.039964:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789776352.040093:0:6549:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789776352.041463:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789776352.041718:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789776352.042148:0:6493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789776352.042157:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789776352.042251:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776352.045180:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789776352.045768:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789776352.045801:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789776352.046183:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789776352.046436:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789776352.047277:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789776352.047433:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789776352.047862:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789776352.048034:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789776352.048198:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789776352.048346:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000040:00080000:0.0:1789776352.048937:0:6549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1789776352.049243:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789776352.051456:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789776352.051777:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789776352.051918:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789776352.052099:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789776352.052245:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789776352.052376:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789776352.052760:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789776352.052923:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789776352.053062:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789776352.053355:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789776352.054839:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789776352.055020:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789776352.055176:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789776352.055316:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789776352.056748:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789776352.057011:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789776352.057151:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789776352.057308:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789776352.057476:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000040:00080000:0.0:1789776352.058019:0:6549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789776352.058093:0:6549:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789776352.058098:0:6549:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789776352.058810:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789776352.058968:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789776352.059107:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789776352.059260:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789776352.059423:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789776352.059829:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789776352.060027:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789776352.062414:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789776352.062459:0:6493:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaed6c1c17988 00100000:10000000:2.0:1789776352.062468:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789776352.066798:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789776352.066816:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789776352.066832:0:6493:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789776352.066853:0:6493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789776352.074157:0:6493:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776352.074337:0:6493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789776352.674665:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776353.698804:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776354.724477:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776355.747504:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789776356.285405:0:6794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789776356.771055:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789776357.192634:0:6846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776357.192798:0:6846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1789776357.410638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789776357.410649:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789776357.410652:0:37:0:(import.c:65:import_set_state_nolock()) 0000000027de0477 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776357.410665:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027de0477 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776357.410686:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002568e30c x1876716449434880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776357.410725:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002568e30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449434880:0@lo:38: 00000100:00100000:3.0:1789776357.411015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776357.411089:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434880 00000100:00100000:3.0:1789776357.411095:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434880 00000100:00100000:3.0:1789776357.411127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776357.411133:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f767626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449434880:12345-0@lo:38: 00010000:00080000:3.0:1789776357.411157:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1789776357.411193:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf13b8042cb88457b 00000004:00100000:3.0:1789776357.411241:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776357.411450:0:6518:0:(import.c:65:import_set_state_nolock()) 000000000fefed8e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776357.411516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f767626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876716449434880:12345-0@lo:38: Request processed in 381us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776357.411523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789776357.411565:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002568e30c x1876716449434880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789776357.411579:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789776357.411586:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789776357.411589:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789776357.411591:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000027de0477 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789776357.411597:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002568e30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449434880:0@lo:38: 00000100:00100000:1.0:1789776357.411649:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776357.411661:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449434752:0@lo:400: 00000100:00100000:1.0:1789776357.411698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776357.411753:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449434752 00000100:00100000:3.0:1789776357.411834:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449434752 00000100:00100000:3.0:1789776357.411869:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776357.411875:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fafd20fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3646:x1876716449434752:12345-0@lo:400: 00000100:00100000:3.0:1789776357.412005:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fafd20fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3646:x1876716449434752:12345-0@lo:400: Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776357.412011:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776357.412048:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449434752:0@lo:400: 00010000:00010000:3.0:1789776357.794660:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789776358.434920:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789776358.434928:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cdb443800 from 3 10000000:01000000:0.0:1789776358.434933:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776358.434979:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776358.435005:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776358.435016:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776358.435043:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449435008:0@lo:101: 00000100:00100000:0.0:1789776358.435115:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776358.435184:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab2a6b0c going to sleep for 11 seconds 00000100:00100000:3.0:1789776358.435240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435008 00000100:00100000:3.0:1789776358.435248:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435008 00000100:00100000:3.0:1789776358.435305:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776358.435314:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:6514:x1876716449435008:12345-0@lo:101: 00010000:00010000:3.0:1789776358.435327:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776358.435345:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884582 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776358.435367:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884582 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776358.435377:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884582 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776358.435385:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000187e1f71, rc 0) 00000100:00100000:3.0:1789776358.435470:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6514:x1876716449435008:12345-0@lo:101: Request processed in 158us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776358.435477:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789776358.441378:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449435008:0@lo:101: 00010000:00010000:0.0:1789776358.441621:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776358.441634:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776358.441713:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449435136:0@lo:256: 00000100:00100000:0.0:1789776358.441781:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776358.441911:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab2a6b0c going to sleep for 11 seconds 00000100:00100000:3.0:1789776358.442326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435136 00000100:00100000:3.0:1789776358.442335:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435136 00000100:00100000:3.0:1789776358.442375:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776358.442381:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e4c079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6514:x1876716449435136:12345-0@lo:256: 20000000:01000000:3.0:1789776358.442401:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789776358.442417:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789776358.442420:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789776358.442550:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e4c079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6514:x1876716449435136:12345-0@lo:256: Request processed in 167us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776358.442558:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776358.442770:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449435136:0@lo:256: 10000000:01000000:0.0:1789776358.442811:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789776358.442817:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776358.442826:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776358.819833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776359.685784:0:6947:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776359.685982:0:6947:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789776359.843941:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776360.866784:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776361.892040:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776362.539705:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005687ab92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449435264:0@lo:400: 00000100:00100000:3.0:1789776362.539787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776362.539861:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776362.539868:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb4c607e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449435392:0@lo:400: 00000100:00100000:3.0:1789776362.539951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776362.540006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435392 00000100:00100000:3.0:1789776362.540017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435392 00000100:00100000:3.0:1789776362.540072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776362.540082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad51948b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449435392:12345-0@lo:400: 00000100:00100000:3.0:1789776362.540141:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad51948b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449435392:12345-0@lo:400: Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776362.540148:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789776362.540202:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb4c607e x1876716449435392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776362.540217:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb4c607e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449435392:0@lo:400: 00000100:00100000:1.0:1789776362.540322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435264 00000100:00100000:1.0:1789776362.540327:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435264 00000100:00100000:1.0:1789776362.540372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776362.540379:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009305d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:3646:x1876716449435264:12345-0@lo:400: 00000100:00100000:1.0:1789776362.540420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009305d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:3646:x1876716449435264:12345-0@lo:400: Request processed in 43us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776362.540426:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776362.540635:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005687ab92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449435264:0@lo:400: 00010000:00010000:2.0:1789776362.914975:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776363.938978:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776364.963025:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.986840:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776367.012481:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789776367.105360:0:7445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789776367.105365:0:7445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789776367.105366:0:7445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789776367.107460:0:7445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a0b8c520 00000020:01000004:0.0:1789776367.107481:0:7445:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789776367.107508:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789776367.107522:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004f048bc2) 00000020:00000080:0.0:1789776367.107540:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789776367.179940:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789776367.181727:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789776367.199837:0:7445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789776367.200088:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789776367.200099:0:7445:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789776367.200125:0:7445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb884597 00000020:01000004:2.0:1789776367.200131:0:7445:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789776367.200152:0:7445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789776367.200155:0:7445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789776367.200161:0:7445:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789776367.200187:0:7445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789776367.200192:0:7445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789776367.216248:0:7445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789776367.216290:0:7445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789776367.216294:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789776367.216296:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789776367.216298:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776367.216299:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776367.216300:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776367.216301:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776367.216302:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776367.216304:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776367.216305:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776367.216306:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776367.216308:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776367.216311:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789776367.216314:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776367.216315:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789776367.216316:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776367.216317:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776367.216318:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776367.216320:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776367.216321:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776367.216322:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776367.216323:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776367.216324:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776367.216325:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776367.216351:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789776367.216368:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449435520:0@lo:253: 00000100:00100000:2.0:1789776367.216450:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.216625:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055d3eabf going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.217061:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435520 00000100:00100000:1.0:1789776367.217070:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435520 00000100:00100000:1.0:1789776367.217175:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776367.217184:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a41cd421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449435520:12345-0@lo:253: 20000000:01000000:1.0:1789776367.217220:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789776367.217224:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789776367.217229:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789776367.217233:0:6509:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789776367.217267:0:6509:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789776367.217483:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776367.217890:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789776367.217905:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776367.217921:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789776367.217937:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789776367.217950:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789776367.218005:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789776367.218014:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789776367.218026:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789776367.218033:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789776367.218045:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789776367.218051:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789776367.218063:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789776367.218076:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789776367.218181:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789776367.218191:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776367.218205:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789776367.218210:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776367.218223:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789776367.218228:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776367.218239:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789776367.218244:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789776367.218255:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789776367.218271:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789776367.218280:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789776367.218368:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789776367.218379:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789776367.218391:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789776367.218406:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789776367.218422:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789776367.218428:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789776367.218443:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789776367.218461:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789776367.218467:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789776367.218488:0:6509:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789776367.218971:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789776367.219362:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789776367.219845:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789776367.219867:0:6509:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:1.0:1789776367.219869:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776367.219886:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789776367.219893:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789776367.219908:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789776367.219914:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776367.219934:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789776367.219941:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789776367.219956:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789776367.219972:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789776367.220015:0:6509:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789776367.220023:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789776367.220320:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789776367.220474:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789776367.220489:0:6509:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:1.0:1789776367.220988:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776367.221012:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789776367.221020:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776367.221033:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789776367.221048:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776367.221063:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789776367.221068:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776367.221081:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789776367.221126:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789776367.221150:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789776367.221154:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789776367.221158:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789776367.221220:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789776367.221222:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789776367.221559:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789776367.221581:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789776367.221595:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789776367.221934:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789776367.221954:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789776367.221968:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789776367.221975:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789776367.221977:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789776367.222365:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789776367.222383:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789776367.222409:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789776367.222798:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789776367.222821:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789776367.222834:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789776367.222843:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789776367.222845:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789776367.223069:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789776367.223084:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789776367.223095:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789776367.223237:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789776367.223254:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789776367.223275:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789776367.223286:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789776367.223289:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789776367.223294:0:6509:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789776367.223299:0:6509:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789776367.223591:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789776367.223867:0:6509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789776367.232131:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789776367.232163:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232199:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232206:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232213:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884558 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232219:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232260:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232274:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 12 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.232288:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435648:0@lo:104: 00000100:00100000:1.0:1789776367.232353:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776367.232479:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.232487:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 12 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.232522:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005575418 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435776:0@lo:104: 00000100:00100000:1.0:1789776367.232547:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776367.233005:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.233020:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.233029:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f678e9b0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435904:0@lo:104: 00000100:00100000:1.0:1789776367.233053:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.233065:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037b5c0a9 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.233089:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435648 00000100:00100000:0.0:1789776367.233098:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435648 00000100:00100000:2.0:1789776367.233119:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435776 00000100:00100000:2.0:1789776367.233122:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435776 00000100:00100000:2.0:1789776367.233154:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449435904 00000100:00100000:2.0:1789776367.233157:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449435904 00000100:00100000:2.0:1789776367.233171:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776367.233179:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006609919c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6509:x1876716449435776:12345-0@lo:104: 00010000:00010000:2.0:1789776367.233191:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.233436:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005575418 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435776:0@lo:104: 00010000:00010000:2.0:1789776367.233441:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776367.233446:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006609919c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6509:x1876716449435776:12345-0@lo:104: Request processed in 269us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.233454:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776367.233472:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776367.233478:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b0c7ec8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6509:x1876716449435904:12345-0@lo:104: 00010000:00010000:3.0:1789776367.233482:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776367.233485:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233487:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233521:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c27a56fb already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776367.233524:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233532:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.233536:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1789776367.233539:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.233540:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b0c7ec8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6509:x1876716449435904:12345-0@lo:104: Request processed in 64us (487us total) trans 0 rc 0/0 10000000:01000000:3.0:1789776367.233545:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789776367.233546:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789776367.233579:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233586:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776367.233601:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233607:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000c27a56fb/0xf13b8042cb8844e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233620:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776367.233622:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233627:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bcdba85a already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776367.233629:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233635:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776367.233640:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776367.233644:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776367.233656:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233662:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776367.233674:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233690:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb8844cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8844d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233700:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.233701:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.233703:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776367.233717:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776367.233721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fef2f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449436032:0@lo:103: 00000100:00100000:2.0:1789776367.233725:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000573dd532 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6509:x1876716449435648:12345-0@lo:104: 00010000:00010000:2.0:1789776367.233737:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.233750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776367.233766:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776367.233770:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000573dd532 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6509:x1876716449435648:12345-0@lo:104: Request processed in 48us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.233776:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776367.233787:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449436160:0@lo:103: 00000100:00100000:3.0:1789776367.233808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.233847:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436032 00000100:00100000:3.0:1789776367.233851:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436032 00000100:00100000:1.0:1789776367.233855:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435648:0@lo:104: 00000100:00100000:1.0:1789776367.233863:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f678e9b0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1876716449435904:0@lo:104: 00010000:00010000:3.0:1789776367.233868:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 13 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.233882:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.233884:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436160 00000100:00100000:3.0:1789776367.233886:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436160 00010000:00010000:3.0:1789776367.233894:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 14 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.233906:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776367.233911:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015b70cf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:3644:x1876716449436032:12345-0@lo:103: 00010000:00010000:3.0:1789776367.233920:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776367.233924:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 14 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233932:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 14 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.233936:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789776367.233942:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789776367.233949:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009ba3177a/0xf13b8042cb8844ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8844e8 expref: 14 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.233960:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776367.233997:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015b70cf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:3644:x1876716449436032:12345-0@lo:103: Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.234003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776367.234016:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776367.234021:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000336260a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:3645:x1876716449436160:12345-0@lo:103: 00010000:00010000:3.0:1789776367.234029:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776367.234032:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234039:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234049:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae736fcb/0xf13b8042cb8844d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8844cc expref: 12 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234059:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776367.234082:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000336260a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3645:x1876716449436160:12345-0@lo:103: Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.234087:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776367.234124:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449436160:0@lo:103: 00010000:00010000:3.0:1789776367.234139:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776367.234141:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234157:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006aa0e718 already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776367.234159:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234166:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776367.234171:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776367.234175:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776367.234198:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234204:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776367.234213:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234219:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000006aa0e718/0xf13b8042cb884558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88455f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234231:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.234232:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.234234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776367.234242:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449436288:0@lo:103: 00000100:00100000:3.0:1789776367.234266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.234292:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436288 00000100:00100000:3.0:1789776367.234296:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436288 00010000:00010000:3.0:1789776367.234308:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 11 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.234332:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776367.234338:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060cc4222 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3646:x1876716449436288:12345-0@lo:103: 00010000:00010000:3.0:1789776367.234346:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776367.234349:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 11 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234356:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 11 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234365:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88455f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884558 expref: 11 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234376:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234383:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234394:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234401:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234407:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234412:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234429:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002adf72a5 already unused, calling callback (000000004c80d481) 00010000:00010000:3.0:1789776367.234432:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234439:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234451:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234460:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776367.234485:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060cc4222 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:3646:x1876716449436288:12345-0@lo:103: Request processed in 148us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.234509:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789776367.234525:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234532:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.234538:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002adf72a5/0xf13b8042cb88459e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789776367.234552:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:0.0:1789776367.234845:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776367.234851:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449436288:0@lo:103: 00000100:00100000:2.0:1789776367.234944:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fef2f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449436032:0@lo:103: 00000100:00100000:3.0:1789776367.236057:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a41cd421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:7445:x1876716449435520:12345-0@lo:253: Request processed in 18872us (19605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.236067:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776367.236130:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449435520:0@lo:253: 10000000:01000000:2.0:1789776367.236151:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789776367.236155:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789776367.236156:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789776367.236158:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776367.236159:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789776367.236160:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776367.236161:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776367.236162:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776367.236164:0:7445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789776367.236166:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776367.236167:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789776367.236181:0:7445:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a0b8c520 from lustre-MDT0001 10000000:01000000:2.0:1789776367.236204:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789776367.236206:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789776367.236212:0:7445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5cc8c63370 local copy 10000000:01000000:2.0:1789776367.236215:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789776367.236253:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.236262:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.236288:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.236314:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436416:0@lo:101: 00000100:00100000:2.0:1789776367.236353:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.236726:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436416 00000100:00100000:3.0:1789776367.236737:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436416 00000100:00100000:2.0:1789776367.236743:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000262c35ab going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.236843:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776367.236851:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd571af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:7445:x1876716449436416:12345-0@lo:101: 00010000:00010000:3.0:1789776367.236863:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.236874:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000580570f0/0xf13b8042cb8845ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8845a5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.236893:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000580570f0/0xf13b8042cb8845ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8845a5 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.236908:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000580570f0/0xf13b8042cb8845ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8845a5 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.236918:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000580570f0, rc 0) 00000100:00100000:3.0:1789776367.236955:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd571af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:7445:x1876716449436416:12345-0@lo:101: Request processed in 105us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.236961:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776367.236989:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436416:0@lo:101: 00010000:00010000:2.0:1789776367.236999:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.237006:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.237094:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436544:0@lo:501: 00000100:00100000:2.0:1789776367.237132:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.237150:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000262c35ab going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.237217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436544 00000100:00100000:3.0:1789776367.237221:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436544 00000100:00100000:3.0:1789776367.237259:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776367.237264:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ceb656e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:7445:x1876716449436544:12345-0@lo:501: 00000100:00100000:3.0:1789776367.237338:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ceb656e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:7445:x1876716449436544:12345-0@lo:501: Request processed in 73us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776367.237344:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776367.238271:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436544:0@lo:501: 10000000:01000000:2.0:1789776367.238288:0:7445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789776367.238316:0:7445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789776367.238322:0:7445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.238331:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.238337:0:7445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.238375:0:7445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776367.238404:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5cd0f5c800 10000000:01000000:2.0:1789776367.238409:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776367.238415:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a5cc8c63370 10000000:01000000:2.0:1789776367.238417:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789776367.238420:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a5cc8c63370 from 1 10000000:01000000:2.0:1789776367.238423:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789776367.238463:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776367.238464:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238472:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.238474:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238513:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094e7c809 already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776367.238523:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238539:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.238541:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776367.238550:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776367.238561:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789776367.238584:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436672:0@lo:101: 00000100:00100000:2.0:1789776367.238624:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.238650:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00010000:00010000:3.0:1789776367.238729:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238737:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776367.238764:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238771:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb8845a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb8845ac expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.238787:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.238788:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776367.238790:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776367.238798:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776367.238808:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449436800:0@lo:103: 00000100:00100000:3.0:1789776367.238839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.238869:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436800 00000100:00100000:3.0:1789776367.238874:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436800 00000100:00100000:3.0:1789776367.238912:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776367.238954:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436672 00000100:00100000:0.0:1789776367.238959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436672 00000100:00100000:0.0:1789776367.238988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789776367.238992:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c82923 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3644:x1876716449436800:12345-0@lo:103: 00000100:00100000:0.0:1789776367.238999:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c892dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:7445:x1876716449436672:12345-0@lo:101: 00010000:00010000:3.0:1789776367.239007:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776367.239011:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776367.239023:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058410317/0xf13b8042cb8845ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8845b3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.239027:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000580570f0/0xf13b8042cb8845ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8845a5 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.239048:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776367.239051:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058410317/0xf13b8042cb8845ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8845b3 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.239062:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058410317/0xf13b8042cb8845ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8845b3 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.239068:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058410317, rc 0) 00000100:00100000:3.0:1789776367.239080:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c82923 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:3644:x1876716449436800:12345-0@lo:103: Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.239087:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776367.239139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449436800:0@lo:103: 00000100:00100000:0.0:1789776367.239141:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c892dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:7445:x1876716449436672:12345-0@lo:101: Request processed in 142us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.239160:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776367.239213:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436672:0@lo:101: 00010000:00010000:2.0:1789776367.239225:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239234:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.239247:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789776367.239258:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239271:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000092a6d67e/0xf13b8042cb8845b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.239279:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a5cd0f5c800 10000000:01000000:2.0:1789776367.239283:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789776367.239286:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a5cd0f5c800 from 1 10000000:01000000:2.0:1789776367.239288:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789776367.239307:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239313:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239319:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.239329:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436928:0@lo:101: 00000100:00100000:2.0:1789776367.239354:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.239377:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.239575:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449436928 00000100:00100000:3.0:1789776367.239580:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449436928 00000100:00100000:3.0:1789776367.239611:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789776367.239618:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c92cc990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+10:7445:x1876716449436928:12345-0@lo:101: 00010000:00010000:3.0:1789776367.239626:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.239634:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061d82914/0xf13b8042cb8845c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8845c1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.239649:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061d82914/0xf13b8042cb8845c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8845c1 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.239656:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061d82914/0xf13b8042cb8845c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8845c1 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.239663:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061d82914, rc 0) 00000100:00100000:3.0:1789776367.239692:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c92cc990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:7445:x1876716449436928:12345-0@lo:101: Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.239698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776367.239781:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449436928:0@lo:101: 00010000:00010000:2.0:1789776367.239791:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239798:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.239808:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789776367.239824:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239836:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000baee974e/0xf13b8042cb8845c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.239842:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789776367.239846:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776367.239850:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a5cd0f5c800 10000000:01000000:2.0:1789776367.239858:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789776367.239861:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789776367.239863:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789776367.239877:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239884:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.239891:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.239901:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437056:0@lo:101: 00000100:00100000:2.0:1789776367.239925:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.239950:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.239974:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437056 00000100:00100000:1.0:1789776367.239979:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437056 00000100:00100000:1.0:1789776367.240053:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776367.240061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eee79b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+11:7445:x1876716449437056:12345-0@lo:101: 00010000:00010000:1.0:1789776367.240068:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776367.240088:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd3fa1c7/0xf13b8042cb8845d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8845cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.240114:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd3fa1c7/0xf13b8042cb8845d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.240123:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd3fa1c7/0xf13b8042cb8845d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.240128:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd3fa1c7, rc 0) 00000100:00100000:1.0:1789776367.240175:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eee79b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437056:12345-0@lo:101: Request processed in 116us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.240182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776367.240229:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437056:0@lo:101: 00010000:00010000:2.0:1789776367.240238:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.240244:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.240327:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437184:0@lo:501: 00000100:00100000:2.0:1789776367.240350:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.240373:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.240415:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437184 00000100:00100000:3.0:1789776367.240419:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437184 00000100:00100000:3.0:1789776367.240459:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776367.240471:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c1e58f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437184:12345-0@lo:501: 00000100:00100000:3.0:1789776367.240693:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c1e58f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437184:12345-0@lo:501: Request processed in 223us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.240701:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789776367.240902:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437184:0@lo:501: 00000100:00100000:2.0:1789776367.240934:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437312:0@lo:503: 00000100:00100000:2.0:1789776367.240976:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.241004:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.241057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437312 00000100:00100000:0.0:1789776367.241062:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437312 00000100:00100000:0.0:1789776367.241096:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776367.241113:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d259279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437312:12345-0@lo:503: 00000100:00100000:0.0:1789776367.241272:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d259279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437312:12345-0@lo:503: Request processed in 160us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.241279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789776367.241352:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437312:0@lo:503: 00000040:00080000:2.0:1789776367.241778:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776367.241847:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437440:0@lo:502: 00000100:00100000:2.0:1789776367.241881:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.241944:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.242569:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437440 00000100:00100000:3.0:1789776367.242576:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437440 00000100:00100000:3.0:1789776367.242616:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776367.242624:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e17990b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437440:12345-0@lo:502: 00000100:00100000:3.0:1789776367.243070:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e17990b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437440:12345-0@lo:502: Request processed in 447us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.243078:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789776367.243706:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437440:0@lo:502: 00000040:00080000:2.0:1789776367.243938:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789776367.243969:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789776367.243984:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789776367.243998:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789776367.244010:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789776367.244023:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789776367.244035:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789776367.244046:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789776367.244057:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789776367.244068:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789776367.244080:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789776367.244093:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789776367.244121:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789776367.244159:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789776367.244174:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789776367.244187:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789776367.244197:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789776367.244208:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789776367.244220:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789776367.244233:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789776367.244246:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789776367.244257:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789776367.244270:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789776367.244301:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437568:0@lo:502: 00000100:00100000:2.0:1789776367.244350:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.244379:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091cbc490 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.244459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437568 00000100:00100000:0.0:1789776367.244465:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437568 00000100:00100000:0.0:1789776367.244548:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776367.244562:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0ccb3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437568:12345-0@lo:502: 00000100:00100000:0.0:1789776367.244674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0ccb3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:7445:x1876716449437568:12345-0@lo:502: Request processed in 119us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.244726:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca76a96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449437568:0@lo:502: 00000040:00080000:3.0:1789776367.244780:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789776367.244788:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:0.0:1789776367.245691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000020:01000000:3.0:1789776367.246192:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776367.246204:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.246206:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789776367.246211:0:7459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789776367.246214:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776367.246229:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000075deb4cd) 00000020:00000080:3.0:1789776367.246247:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789776367.246391:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789776367.247439:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789776367.247454:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb8845e4 00000020:00000080:3.0:1789776367.247920:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789776367.247927:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776367.247932:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.247933:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789776367.247936:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776367.247945:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.247947:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789776367.247950:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776367.247959:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b4dc6299) 00000020:00000080:3.0:1789776367.247972:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789776367.247975:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789776367.247977:0:7459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789776367.247992:0:7459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789776367.247999:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789776367.248462:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a0b8c520 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789776367.248476:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000085119a41) 00000020:00000080:3.0:1789776367.248579:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789776367.249134:0:7459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789776367.249141:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb8845f9 00000020:00000080:3.0:1789776367.249266:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789776367.249272:0:7459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789776367.249277:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf13b8042cb884600 00080000:01000000:3.0:1789776367.249283:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789776367.249286:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb884607 00080000:10000000:3.0:1789776367.249807:0:7459:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789776367.249944:0:7459:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789776367.320626:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789776367.320905:0:7459:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789776367.323812:0:7459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789776367.325394:0:7459:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 10000000:01000000:1.0:1789776367.339459:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789776367.339468:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cdb443800 from 21 10000000:01000000:1.0:1789776367.339472:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776367.339532:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.339546:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.339556:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.339579:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f678e9b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437696:0@lo:101: 00000100:00100000:1.0:1789776367.339660:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.339723:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a725798 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.341162:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437696 00000100:00100000:3.0:1789776367.341174:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437696 00000100:00100000:3.0:1789776367.341241:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789776367.341250:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000b94def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+12:6514:x1876716449437696:12345-0@lo:101: 00010000:00010000:3.0:1789776367.341277:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.341294:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000580570f0/0xf13b8042cb884615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88460e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.341320:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000580570f0/0xf13b8042cb884615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88460e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.341351:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000580570f0/0xf13b8042cb884615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88460e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.341360:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000580570f0, rc 0) 00000100:00100000:3.0:1789776367.341437:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000b94def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:6514:x1876716449437696:12345-0@lo:101: Request processed in 188us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.341443:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776367.342636:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f678e9b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437696:0@lo:101: 00010000:00010000:2.0:1789776367.342658:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.342669:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.343264:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437824:0@lo:501: 00000100:00100000:3.0:1789776367.343623:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.343764:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091077041 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.347431:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437824 00000100:00100000:1.0:1789776367.347446:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437824 00000100:00100000:1.0:1789776367.348024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776367.348034:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003359371e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:6514:x1876716449437824:12345-0@lo:501: 00000100:00100000:1.0:1789776367.348221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003359371e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:6514:x1876716449437824:12345-0@lo:501: Request processed in 188us (4598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.348229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789776367.348721:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094d7ac6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437824:0@lo:501: 00000100:00100000:2.0:1789776367.348775:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082a0235e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437952:0@lo:503: 00000100:00100000:2.0:1789776367.348834:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.348884:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e0586c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.349188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449437952 00000100:00100000:1.0:1789776367.349195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449437952 00000100:00100000:1.0:1789776367.349251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776367.349260:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a7b7112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:6514:x1876716449437952:12345-0@lo:503: 00000100:00100000:1.0:1789776367.349370:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a7b7112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:6514:x1876716449437952:12345-0@lo:503: Request processed in 112us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.349378:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776367.349433:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082a0235e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449437952:0@lo:503: 00000100:00100000:3.0:1789776367.349942:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d418c6cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7460:1876716449438080:0@lo:502: 00000100:00100000:3.0:1789776367.349980:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.350012:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000007549761a going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.350069:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438080 00000100:00100000:2.0:1789776367.350075:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438080 00000100:00100000:2.0:1789776367.350115:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789776367.350122:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea12562e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:7460:x1876716449438080:12345-0@lo:502: 00000100:00100000:2.0:1789776367.350221:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea12562e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:7460:x1876716449438080:12345-0@lo:502: Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.350229:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776367.350567:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d418c6cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7460:1876716449438080:0@lo:502: 00000020:00000080:0.0:1789776367.354705:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789776367.354721:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776367.354728:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.354731:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789776367.354736:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776367.354743:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.354745:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789776367.354748:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776367.354754:0:7459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:0.0:1789776367.354782:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776367.354798:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000000c0a628c) 00000020:00000080:0.0:1789776367.354819:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789776367.354830:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776367.354918:0:7459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789776367.354925:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789776367.354932:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb884623 00010000:00080000:0.0:1789776367.354966:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f4da641@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776367.356628:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000100:00100000:1.0:1789776367.358789:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7460:1876716449438208:0@lo:502: 00000100:00100000:1.0:1789776367.358883:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.358979:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000020113f63 going to sleep for 11 seconds 00000020:00000080:0.0:1789776367.361354:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776367.361371:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000100:00100000:3.0:1789776367.362391:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438208 00000100:00100000:3.0:1789776367.362404:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438208 00000100:00100000:3.0:1789776367.362537:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789776367.362547:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ed55c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:7460:x1876716449438208:12345-0@lo:502: 00000004:01000000:0.0:1789776367.362563:0:7459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789776367.362592:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb88462a 00000100:00080000:0.0:1789776367.362601:0:7459:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776367.362606:0:7459:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002f4da641 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776367.362635:0:7459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ecb1053e x1876716449438336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776367.362658:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789776367.362724:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776367.362730:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.362732:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789776367.362736:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776367.362739:0:7459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789776367.362741:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776367.362742:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776367.362744:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:3.0:1789776367.362747:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ed55c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:7460:x1876716449438208:12345-0@lo:502: Request processed in 199us (3863us total) trans 0 rc 0/0 00000020:00000080:0.0:1789776367.362749:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.362752:0:7459:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776367.362757:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1789776367.362762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:00000080:0.0:1789776367.362763:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.362766:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789776367.362771:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789776367.363454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449438336:0@lo:38: 00000100:00100000:3.0:1789776367.363621:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:0.0:1789776367.363641:0:7459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789776367.363672:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776367.363683:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.363685:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789776367.363688:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776367.363691:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.363692:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789776367.363695:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776367.363697:0:7459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789776367.363718:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776367.363721:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.363722:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789776367.363725:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1789776367.363851:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789776367.363884:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789776367.363894:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.363905:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000052349529/0xf13b8042cb8845cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776367.363914:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cd0f5c800 from 1 10000000:01000000:1.0:1789776367.363917:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776367.363941:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.363948:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.363964:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.363979:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005575418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438464:0@lo:101: 00000100:00100000:1.0:1789776367.364012:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776367.364913:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089fa557c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449438592:0@lo:400: 00000100:00100000:0.0:1789776367.364958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776367.365350:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438592 00000100:00100000:0.0:1789776367.365358:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438592 00000100:00100000:0.0:1789776367.365401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776367.365409:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4cbfdfe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449438592:12345-0@lo:400: 00000100:00100000:0.0:1789776367.365665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4cbfdfe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449438592:12345-0@lo:400: Request processed in 256us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.365672:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789776367.365729:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000089fa557c x1876716449438592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776367.365742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089fa557c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449438592:0@lo:400: 00000100:00100000:3.0:1789776367.365790:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7460:1876716449438208:0@lo:502: 00000040:00080000:3.0:1789776367.365833:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000100:00100000:1.0:1789776367.366112:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048444ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.366139:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438336 00000100:00100000:1.0:1789776367.366150:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438336 00000100:00100000:1.0:1789776367.366184:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776367.366189:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000682b42af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449438336:12345-0@lo:38: 00010000:00080000:1.0:1789776367.366209:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1789776367.366245:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb884638 00000004:00100000:1.0:1789776367.366261:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789776367.366267:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789776367.366573:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438464 00000100:00100000:3.0:1789776367.366577:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438464 00000100:00100000:3.0:1789776367.366604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776367.366619:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e305f21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:7445:x1876716449438464:12345-0@lo:101: 00010000:00010000:3.0:1789776367.366629:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.366644:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884631 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.366671:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884631 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.366682:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884631 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.366756:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090b3c1f8, rc 0) 00000100:00100000:3.0:1789776367.366803:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e305f21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:7445:x1876716449438464:12345-0@lo:101: Request processed in 186us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.366809:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776367.367558:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005575418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438464:0@lo:101: 00010000:00010000:0.0:1789776367.367578:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.367589:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.368174:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001e2d594 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438720:0@lo:256: 00000100:00100000:0.0:1789776367.368235:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776367.368276:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d532359 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.368297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438720 00000100:00100000:0.0:1789776367.368304:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438720 00000100:00100000:0.0:1789776367.368353:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789776367.368361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086e8407a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:7445:x1876716449438720:12345-0@lo:256: 20000000:01000000:0.0:1789776367.368384:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789776367.368952:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789776367.368957:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789776367.369059:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086e8407a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:7445:x1876716449438720:12345-0@lo:256: Request processed in 698us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.369068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789776367.369523:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001e2d594 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438720:0@lo:256: 00000020:01000000:2.0:1789776367.369617:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789776367.369650:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776367.369659:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.369670:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000002adf72a5/0xf13b8042cb88460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.369679:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789776367.369681:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789776367.369684:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776367.369714:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.369722:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.369730:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.369747:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ccba2bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449438848:0@lo:101: 00000100:00100000:2.0:1789776367.369784:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.369823:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000394dde83 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.369942:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438848 00000100:00100000:3.0:1789776367.369948:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438848 00000100:00100000:3.0:1789776367.369981:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789776367.369988:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083722213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:6514:x1876716449438848:12345-0@lo:101: 00010000:00010000:3.0:1789776367.369998:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.370010:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac2b6ad0/0xf13b8042cb88464d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884646 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.370031:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac2b6ad0/0xf13b8042cb88464d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884646 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.370039:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac2b6ad0/0xf13b8042cb88464d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884646 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.370053:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac2b6ad0, rc 0) 00000100:00100000:3.0:1789776367.370088:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083722213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449438848:12345-0@lo:101: Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.370094:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 10000000:01000000:1.0:1789776367.370433:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776367.370439:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.370447:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776367.370455:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cd0f5c800 from 1 10000000:01000000:1.0:1789776367.370458:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776367.370488:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.370515:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.370522:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.370536:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438976:0@lo:101: 00000100:00100000:1.0:1789776367.370566:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.370605:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015654253 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.370677:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449438976 00000100:00100000:0.0:1789776367.370682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449438976 00000100:00100000:0.0:1789776367.370717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789776367.370723:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4998a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:7445:x1876716449438976:12345-0@lo:101: 00010000:00010000:0.0:1789776367.370731:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776367.370739:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884654 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.370753:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884654 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.370760:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884654 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.370776:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a9bfcf0, rc 0) 00000100:00100000:0.0:1789776367.370814:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4998a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7445:x1876716449438976:12345-0@lo:101: Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.370820:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776367.370961:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ccba2bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449438848:0@lo:101: 00010000:00010000:2.0:1789776367.370993:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.371001:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.371049:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ccba2bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449439104:0@lo:501: 00000100:00100000:2.0:1789776367.371075:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.371114:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000394dde83 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.371898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439104 00000100:00100000:0.0:1789776367.371905:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439104 00000100:00100000:0.0:1789776367.371944:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789776367.371952:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb858537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449439104:12345-0@lo:501: 00000100:00100000:0.0:1789776367.372107:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb858537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449439104:12345-0@lo:501: Request processed in 146us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.372115:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789776367.372146:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ccba2bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449439104:0@lo:501: 00000100:00100000:3.0:1789776367.372182:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7b1a20f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449439232:0@lo:503: 00000100:00100000:3.0:1789776367.372223:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.372255:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be62a051 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.373592:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439232 00000100:00100000:0.0:1789776367.373603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439232 00000100:00100000:0.0:1789776367.373653:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789776367.373660:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000963f24c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449439232:12345-0@lo:503: 00000100:00100000:0.0:1789776367.373793:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000963f24c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449439232:12345-0@lo:503: Request processed in 134us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.373800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789776367.373848:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7b1a20f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449439232:0@lo:503: 00000100:00100000:1.0:1789776367.375211:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449438976:0@lo:101: 00010000:00010000:1.0:1789776367.375235:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.375248:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.375389:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439360:0@lo:501: 00000100:00100000:1.0:1789776367.375441:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.375485:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015654253 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.375689:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439360 00000100:00100000:0.0:1789776367.375695:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439360 00000100:00100000:0.0:1789776367.375735:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789776367.375744:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c879415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7445:x1876716449439360:12345-0@lo:501: 00000100:00100000:0.0:1789776367.375858:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c879415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7445:x1876716449439360:12345-0@lo:501: Request processed in 116us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.375879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789776367.375939:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439360:0@lo:501: 00000100:00100000:2.0:1789776367.375973:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439488:0@lo:503: 00000100:00100000:2.0:1789776367.376026:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.376056:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a22f9ba going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.376128:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439488 00000100:00100000:0.0:1789776367.376133:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439488 00000100:00100000:0.0:1789776367.376167:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776367.376173:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003119d0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7445:x1876716449439488:12345-0@lo:503: 00000040:00080000:0.0:1789776367.376203:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789776367.376252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003119d0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7445:x1876716449439488:12345-0@lo:503: Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.376259:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789776367.376363:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439488:0@lo:503: 00000040:00080000:2.0:1789776367.376695:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776367.376745:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789776367.376812:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776367.377708:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789776367.378072:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789776367.378110:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776367.378118:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378129:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776367.378182:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789776367.378186:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5cd0f5c800 10000000:01000000:3.0:1789776367.378189:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5cd0f5c800 10000000:01000000:3.0:1789776367.378194:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:0.0:1789776367.378197:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fffcb25e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7465:1876716449439616:0@lo:502: 10000000:01000000:3.0:1789776367.378203:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cd0f5c800 from 1 10000000:01000000:3.0:1789776367.378207:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776367.378233:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378253:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.378272:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776367.378286:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.378300:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002eb258ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439744:0@lo:101: 00000100:00100000:0.0:1789776367.378321:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8d63229 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.378337:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.378360:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be62a051 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.378422:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439616 00000100:00100000:2.0:1789776367.378428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439616 00000100:00100000:2.0:1789776367.378465:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439744 00000100:00100000:2.0:1789776367.378468:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439744 00000100:00100000:2.0:1789776367.378482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776367.378489:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e4a29c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7465:x1876716449439616:12345-0@lo:502: 00000100:00100000:3.0:1789776367.378542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776367.378552:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e699a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449439744:12345-0@lo:101: 00010000:00010000:3.0:1789776367.378562:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.378574:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dffcaf61/0xf13b8042cb884669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884662 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378594:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dffcaf61/0xf13b8042cb884669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884662 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378603:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dffcaf61/0xf13b8042cb884669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884662 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378610:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dffcaf61, rc 0) 00000100:00100000:2.0:1789776367.378623:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e4a29c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7465:x1876716449439616:12345-0@lo:502: Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.378633:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776367.378649:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e699a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7445:x1876716449439744:12345-0@lo:101: Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.378656:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776367.378701:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002eb258ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439744:0@lo:101: 00010000:00010000:3.0:1789776367.378711:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.378718:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.378768:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fffcb25e pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7465:1876716449439616:0@lo:502: 00000020:01000000:0.0:1789776367.378794:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1789776367.378803:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002eb258ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439872:0@lo:501: 00000020:00000080:0.0:1789776367.378804:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.378808:0:7465:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789776367.378816:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776367.378820:0:7465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000100:00100000:3.0:1789776367.378835:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789776367.378845:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1789776367.378858:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be62a051 going to sleep for 11 seconds 00000020:00000080:0.0:1789776367.378860:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000009643003a) 00000020:00000080:0.0:1789776367.378879:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:0.0:1789776367.378885:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776367.378974:0:7465:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789776367.378979:0:7465:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789776367.378986:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb884677 00010000:00080000:0.0:1789776367.379015:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005d5d249f@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00000100:00080000:1.0:1789776367.379698:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000fcd17e6b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776367.380065:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776367.380073:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789776367.380082:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789776367.380087:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789776367.380089:0:3642:0:(import.c:65:import_set_state_nolock()) 000000002f4da641 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789776367.380119:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecb1053e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449438336:0@lo:38: 00000100:00100000:2.0:1789776367.380120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449439872 00000100:00100000:2.0:1789776367.380129:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449439872 00000100:00100000:2.0:1789776367.380175:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789776367.380185:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449440000:0@lo:41: 00000100:00100000:2.0:1789776367.380186:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e708f180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449439872:12345-0@lo:501: 00000100:00100000:2.0:1789776367.380713:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e708f180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449439872:12345-0@lo:501: Request processed in 530us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.380721:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776367.380776:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002eb258ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449439872:0@lo:501: 00000100:00100000:2.0:1789776367.380808:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440128:0@lo:503: 00000100:00100000:2.0:1789776367.380852:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.380882:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009119e98 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.380899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440128 00000100:00100000:2.0:1789776367.380903:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440128 00000100:00100000:2.0:1789776367.380929:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776367.380935:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e43360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440128:12345-0@lo:503: 00000100:00100000:2.0:1789776367.381016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e43360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440128:12345-0@lo:503: Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.381023:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776367.381065:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440128:0@lo:503: 00000040:00080000:2.0:1789776367.381349:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776367.381402:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440256:0@lo:502: 00000100:00100000:2.0:1789776367.381437:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.381460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440256 00000100:00100000:2.0:1789776367.381464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440256 00000100:00100000:2.0:1789776367.381534:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776367.381543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a1ad3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440256:12345-0@lo:502: 00000100:00100000:2.0:1789776367.381625:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a1ad3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440256:12345-0@lo:502: Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.381632:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776367.381674:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009119e98 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.381687:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440256:0@lo:502: 00000040:00080000:2.0:1789776367.381842:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789776367.381866:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789776367.381879:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789776367.381890:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789776367.381901:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789776367.381925:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789776367.381938:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789776367.381948:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789776367.381959:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789776367.381970:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789776367.381981:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789776367.381992:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789776367.382003:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789776367.382013:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789776367.382024:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789776367.382035:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789776367.382045:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789776367.382056:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789776367.382068:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789776367.382080:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000100:00100000:1.0:1789776367.383405:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000682b42af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449438336:12345-0@lo:38: Request processed in 17208us (19779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.383420:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776367.383848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.383969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440000 00000100:00100000:1.0:1789776367.384095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440000 00000100:00100000:1.0:1789776367.384153:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776367.384163:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001329d3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449440000:12345-0@lo:41: 00000004:00000024:1.0:1789776367.384200:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789776367.384253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001329d3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449440000:12345-0@lo:41: Request processed in 92us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.384260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776367.384462:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449440000:0@lo:41: 00010000:00010000:0.0:1789776367.388867:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-3 is initialized 00000040:00080000:2.0:1789776367.389109:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789776367.389165:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789776367.389180:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789776367.389194:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789776367.389206:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789776367.389217:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789776367.389238:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789776367.389250:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789776367.389295:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440384:0@lo:502: 00000100:00100000:2.0:1789776367.389377:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.389423:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009119e98 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.390841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440384 00000100:00100000:2.0:1789776367.390856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440384 00000100:00100000:2.0:1789776367.390917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789776367.390927:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ba4143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440384:12345-0@lo:502: 00000100:00100000:2.0:1789776367.391072:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ba4143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7445:x1876716449440384:12345-0@lo:502: Request processed in 148us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.391080:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789776367.391191:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9b0fddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449440384:0@lo:502: 00000040:00080000:3.0:1789776367.391279:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789776367.391291:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789776367.392050:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789776367.392073:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000051825509) 00000020:00000080:2.0:1789776367.392095:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:2.0:1789776367.392200:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a0b8c520 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789776367.392205:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a0b8c520 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789776367.392207:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a0b8c520 3 00010000:00080000:2.0:1789776367.392236:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000f49cfc2@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776367.394215:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:2.0:1789776367.394414:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789776367.394451:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776367.394463:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf13b8042cb884685 00000100:00080000:2.0:1789776367.394474:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776367.394480:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000000f49cfc2 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776367.394537:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095b61332 x1876716449440512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776367.394569:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789776367.394674:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095b61332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449440512:0@lo:38: 00000100:00100000:0.0:1789776367.394761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.399264:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440512 00000100:00100000:2.0:1789776367.399281:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440512 00000100:00100000:2.0:1789776367.399327:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776367.399334:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fffcb25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449440512:12345-0@lo:38: 00010000:00080000:2.0:1789776367.399361:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1789776367.399416:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf13b8042cb88468c 00000004:00100000:2.0:1789776367.399433:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789776367.399572:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000f1f0dd2f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776367.399662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fffcb25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876716449440512:12345-0@lo:38: Request processed in 328us (4901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.399670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789776367.399742:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000095b61332 x1876716449440512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776367.399754:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776367.399762:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789776367.399769:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789776367.399773:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789776367.399775:0:3642:0:(import.c:65:import_set_state_nolock()) 000000000f49cfc2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776367.399780:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095b61332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449440512:0@lo:38: 00000020:00000080:1.0:1789776367.400009:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776367.400021:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789776367.400060:0:7465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789776367.400080:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb884693 00000100:00080000:1.0:1789776367.400086:0:7465:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776367.400110:0:7465:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000005d5d249f using connection 192.168.204.127@tcp/0@lo 00000040:00080000:2.0:1789776367.400116:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1789776367.400135:0:7465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000030e092a2 x1876716449440640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776367.400176:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030e092a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449440640:0@lo:38: 00000100:00100000:2.0:1789776367.400218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789776367.400228:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789776367.400262:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789776367.400266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440640 00000100:00100000:2.0:1789776367.400270:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440640 00000100:00100000:2.0:1789776367.400296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776367.400301:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095b61332 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876716449440640:12345-0@lo:38: 00000100:00100000:2.0:1789776367.400352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095b61332 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876716449440640:12345-0@lo:38: Request processed in 50us (135us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789776367.400359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776367.400401:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776367.400407:0:3642:0:(import.c:65:import_set_state_nolock()) 000000005d5d249f lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776367.400410:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789776367.400413:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030e092a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449440640:0@lo:38: 00000020:01000000:1.0:1789776367.400941:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776367.400946:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776367.400948:0:7465:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789776367.400952:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776367.400955:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776367.400957:0:7465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776367.400960:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776367.400961:0:7465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789776367.400985:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7465:1876716449440768:0@lo:502: 00000100:00100000:1.0:1789776367.401032:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.401056:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a527fc3 going to sleep for 11 seconds 00000100:00080000:1.0:1789776367.401134:0:7472:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@00000000b2a5cfe5 x1876716449440896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776367.401144:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00000100:00100000:2.0:1789776367.401211:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440768 00000100:00100000:2.0:1789776367.401217:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440768 00000100:00100000:2.0:1789776367.401252:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789776367.401257:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000490af648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7465:x1876716449440768:12345-0@lo:502: 00000100:00100000:2.0:1789776367.401369:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000490af648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:7465:x1876716449440768:12345-0@lo:502: Request processed in 111us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.401377:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776367.401918:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7465:1876716449440768:0@lo:502: 00000020:01000000:1.0:1789776367.401954:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:01000000:3.0:1789776367.401957:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000020:00000080:1.0:1789776367.401959:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776367.401964:0:7465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789776367.401970:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 10000000:01000000:3.0:1789776367.401995:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776367.402004:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.402013:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000075777b01/0xf13b8042cb884662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776367.402068:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776367.402070:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776367.402075:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776367.402076:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776367.402077:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776367.402079:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776367.402079:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776367.402080:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776367.402082:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776367.402083:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776367.402084:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776367.402087:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789776367.402090:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776367.402091:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776367.402092:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776367.402093:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776367.402094:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776367.402107:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776367.402108:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776367.402109:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776367.402110:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776367.402111:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776367.402112:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776367.402126:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789776367.402135:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449441024:0@lo:253: 00000020:01000000:2.0:1789776367.402170:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:3.0:1789776367.402173:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789776367.402199:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1789776367.402203:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8836aab going to sleep for 11 seconds 00010000:00010000:2.0:1789776367.402206:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.402215:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000094e7c809/0xf13b8042cb884646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.402226:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789776367.402229:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5cc8c63370 from 1 10000000:01000000:2.0:1789776367.402231:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 40000000:00080000:3.0:1789776367.402252:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00010000:2.0:1789776367.402256:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.402277:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.402285:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.402299:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449441152:0@lo:101: 00000100:00100000:2.0:1789776367.402333:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.402360:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d478a568 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.402383:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441024 00000100:00100000:2.0:1789776367.402388:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441024 00000100:00100000:2.0:1789776367.402417:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441152 00000100:00100000:2.0:1789776367.402420:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441152 00000100:00100000:2.0:1789776367.402439:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789776367.402447:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097f932c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7445:x1876716449441024:12345-0@lo:253: 20000000:01000000:2.0:1789776367.402478:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789776367.402603:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789776367.402814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776367.402824:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008ced515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449441152:12345-0@lo:101: 00010000:00010000:3.0:1789776367.402834:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.402860:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065cbda55/0xf13b8042cb8846a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88469a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.402881:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065cbda55/0xf13b8042cb8846a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88469a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.402891:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065cbda55/0xf13b8042cb8846a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88469a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.402903:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065cbda55, rc 0) 00000100:00100000:3.0:1789776367.402943:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008ced515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449441152:12345-0@lo:101: Request processed in 122us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.402950:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789776367.403343:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449441152:0@lo:101: 00010000:00010000:2.0:1789776367.403358:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.403367:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.403426:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449441280:0@lo:501: 00000100:00100000:2.0:1789776367.403473:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.403533:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441280 00000100:00100000:3.0:1789776367.403539:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441280 00000100:00100000:3.0:1789776367.403569:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789776367.403574:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af2cd45a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449441280:12345-0@lo:501: 00000100:00100000:3.0:1789776367.403648:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af2cd45a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449441280:12345-0@lo:501: Request processed in 74us (174us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776367.403656:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776367.403668:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d478a568 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.403689:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449441280:0@lo:501: 10000000:01000000:2.0:1789776367.403711:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789776367.403716:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.403723:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000ae736fcb/0xf13b8042cb88469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789776367.414844:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789776367.415172:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789776367.415189:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789776367.415309:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789776367.415316:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789776367.415337:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.415358:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884582 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.415367:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.415373:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.415431:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.415445:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.415459:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c299ac35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449441408:0@lo:104: 00000100:00100000:0.0:1789776367.415880:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.415965:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441408 00000100:00100000:2.0:1789776367.415974:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441408 00000100:00100000:2.0:1789776367.416027:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776367.416037:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b22f363 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449441408:12345-0@lo:104: 00010000:00010000:2.0:1789776367.416049:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416116:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776367.416122:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b22f363 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449441408:12345-0@lo:104: Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.416137:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789776367.416157:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776367.416162:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416169:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bcdba85a already unused, calling callback (000000005a38c4ad) 10000000:00010000:2.0:1789776367.416172:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416195:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776367.416201:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.416206:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776367.416249:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416255:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776367.416274:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416279:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000bcdba85a/0xf13b8042cb884631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88463f expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416293:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776367.416295:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776367.416296:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776367.416308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449441536:0@lo:103: 00000100:00100000:2.0:1789776367.416341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776367.416456:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.416465:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 18 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.416486:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449441664:0@lo:104: 00000100:00100000:1.0:1789776367.416548:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.416572:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059e1e2b0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.416591:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c299ac35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449441408:0@lo:104: 00000100:00100000:2.0:1789776367.416674:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441664 00000100:00100000:2.0:1789776367.416679:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441664 00000100:00100000:0.0:1789776367.416704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441536 00000100:00100000:2.0:1789776367.416710:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776367.416710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441536 00000100:00100000:2.0:1789776367.416721:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003414bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449441664:12345-0@lo:104: 00010000:00010000:2.0:1789776367.416731:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.416738:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 19 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.416760:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097f932c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:7445:x1876716449441024:12345-0@lo:253: Request processed in 14300us (14573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.416772:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776367.416776:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776367.416785:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ac0a8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3646:x1876716449441536:12345-0@lo:103: 00010000:00010000:2.0:1789776367.416801:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789776367.416802:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789776367.416810:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003414bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449441664:12345-0@lo:104: Request processed in 90us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1789776367.416811:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.416826:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776367.416829:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7445:1876716449441024:0@lo:253: 00010000:00010000:0.0:1789776367.416831:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416846:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789776367.416847:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00010000:00010000:0.0:1789776367.416851:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090b3c1f8/0xf13b8042cb88463f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884631 expref: 18 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416852:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776367.416853:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776367.416857:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776367.416861:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776367.416864:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776367.416867:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776367.416870:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:2.0:1789776367.416872:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005eabd287 already unused, calling callback (000000005a38c4ad) 00000020:01000004:3.0:1789776367.416874:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776367.416877:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 10000000:00010000:2.0:1789776367.416877:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.416879:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:3.0:1789776367.416881:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776367.416884:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776367.416886:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1789776367.416890:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776367.416898:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.416903:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:02000000:3.0:1789776367.416904:0:7445:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789776367.416918:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ac0a8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:3646:x1876716449441536:12345-0@lo:103: Request processed in 133us (576us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776367.416926:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.416929:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789776367.416937:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776367.416952:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416958:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000005eabd287/0xf13b8042cb884582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884589 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.416978:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776367.416979:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776367.416981:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776367.416990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a19bd2fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449441792:0@lo:103: 00000100:00100000:2.0:1789776367.417015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.417054:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449441536:0@lo:103: 00000100:00100000:2.0:1789776367.417071:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449441664:0@lo:104: 00010000:00010000:2.0:1789776367.417084:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.417356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441792 00000100:00100000:0.0:1789776367.417360:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441792 00010000:00010000:0.0:1789776367.417375:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776367.417406:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776367.417720:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c280e88f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:3643:x1876716449441792:12345-0@lo:103: 00010000:00010000:0.0:1789776367.417732:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776367.417735:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417743:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417753:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000187e1f71/0xf13b8042cb884589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884582 expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417776:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417784:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776367.417798:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002483506s 00010000:00010000:0.0:1789776367.417801:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417807:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417813:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417818:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417823:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fcbda008 already unused, calling callback (000000004c80d481) 00010000:00010000:0.0:1789776367.417826:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417832:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417853:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.417862:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776367.417903:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c280e88f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3643:x1876716449441792:12345-0@lo:103: Request processed in 491us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.417910:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789776367.420519:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.420538:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.420545:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fcbda008/0xf13b8042cb8846a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.420833:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a19bd2fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449441792:0@lo:103: 00080000:10000000:2.0:1789776367.430150:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789776367.430338:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789776367.430575:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789776367.430771:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789776367.430945:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789776367.431084:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789776367.436550:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789776367.437028:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789776367.437252:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789776367.437479:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789776367.437926:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789776367.439444:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789776367.443628:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789776367.443881:0:7475:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789776367.443886:0:7475:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789776367.444168:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789776367.444222:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876716449441920:0@lo:700: 00000100:00100000:3.0:1789776367.444288:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.444375:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f12394b going to sleep for 11 seconds 00000040:01000000:1.0:1789776367.444421:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789776367.445040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449441920 00000100:00100000:0.0:1789776367.445049:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449441920 00000100:00100000:0.0:1789776367.445136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776367.445146:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000652678bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1876716449441920:12345-0@lo:700: 00000100:00100000:1.0:1789776367.447669:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442048:0@lo:1000: 00000100:00100000:1.0:1789776367.447747:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.447794:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094e6c42b going to sleep for 11 seconds 00000040:01000000:3.0:1789776367.448266:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789776367.448374:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776367.448843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442048 00000100:00100000:2.0:1789776367.448853:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442048 00000100:00100000:2.0:1789776367.448909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776367.448917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030e092a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442048:12345-0@lo:1000: 00000004:00000080:3.0:1789776367.448975:0:7445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789776367.448984:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789776367.449016:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030e092a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442048:12345-0@lo:1000: Request processed in 99us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.449024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776367.449077:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073c5f6ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442048:0@lo:1000: 00000040:01000000:2.0:1789776367.449124:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789776367.449128:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776367.449153:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442176:0@lo:700: 00000100:00100000:2.0:1789776367.449185:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.449210:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000970e0439 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.450249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442176 00000100:00100000:2.0:1789776367.450257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442176 00000100:00100000:2.0:1789776367.450306:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776367.450314:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb386b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442176:12345-0@lo:700: 00000100:00100000:2.0:1789776367.450376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb386b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442176:12345-0@lo:700: Request processed in 63us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.450383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776367.450588:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442176:0@lo:700: 00000100:00100000:1.0:1789776367.450642:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876716449442304:0@lo:900: 00000100:00100000:1.0:1789776367.450676:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.450696:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eeac310b going to sleep for 11 seconds 40000000:02000000:0.0:1789776367.452762:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1789776367.453252:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442304 00000100:00100000:2.0:1789776367.453262:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442304 00000100:00100000:2.0:1789776367.453334:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776367.453344:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005575418 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1876716449442304:12345-0@lo:900: 00000100:00100000:2.0:1789776367.453441:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005575418 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1876716449442304:12345-0@lo:900: Request processed in 98us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.453448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789776367.453509:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e46336a x1876716449442304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776367.453523:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e46336a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876716449442304:0@lo:900: 00000100:00100000:2.0:1789776367.453655:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442432:0@lo:1000: 00000100:00100000:2.0:1789776367.453700:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.453725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442432 00000100:00100000:2.0:1789776367.453728:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442432 00000100:00100000:2.0:1789776367.453753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776367.453758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f750ad90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442432:12345-0@lo:1000: 00000100:00100000:2.0:1789776367.453809:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f750ad90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442432:12345-0@lo:1000: Request processed in 51us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.453815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776367.453829:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090ad3a78 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.453840:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442432:0@lo:1000: 00000004:00080000:2.0:1789776367.453878:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003f63330f with version 0 00000020:00100000:2.0:1789776367.453890:0:7477:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789776367.453895:0:7477:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e207c0d9 x1876716449442688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776367.453906:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442688:0@lo:1000: 00000100:00100000:2.0:1789776367.453929:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.453947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442688 00000100:00100000:2.0:1789776367.453950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442688 00000100:00100000:2.0:1789776367.453967:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776367.453972:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ee4ed4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442688:12345-0@lo:1000: 00000040:00080000:3.0:1789776367.454050:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789776367.454376:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d35585ea going to sleep for 11 seconds 00000040:00080000:3.0:1789776367.456822:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789776367.456902:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789776367.457410:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789776367.458394:0:7445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:1.0:1789776367.461680:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789776367.462151:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ee4ed4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442688:12345-0@lo:1000: Request processed in 8173us (8216us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789776367.462164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1789776367.462751:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789776367.462757:0:7477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789776367.462773:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442688:0@lo:1000: 00000100:00100000:1.0:1789776367.462864:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442816:0@lo:1000: 00000100:00100000:1.0:1789776367.462917:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.462985:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a786cdd going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.463283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449442816 00000100:00100000:2.0:1789776367.463297:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449442816 00000100:00100000:2.0:1789776367.463339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776367.463347:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f678e9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442816:12345-0@lo:1000: 00000100:00100000:2.0:1789776367.463434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f678e9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876716449442816:12345-0@lo:1000: Request processed in 88us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.463441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776367.463846:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876716449442816:0@lo:1000: 00000040:00080000:1.0:1789776367.463868:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789776367.463899:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000094e6c42b with version 1 00100000:10000000:3.0:1789776367.463999:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000004:00080000:2.0:1789776367.464140:0:7463:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004a0131ee version 1 rpc_version 1 00000020:00100000:2.0:1789776367.464161:0:7463:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789776367.464168:0:7463:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bf77a48c x1876716449443072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00100000:10000000:3.0:1789776367.464175:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:2.0:1789776367.464183:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf77a48c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876716449443072:0@lo:1000: 00000100:00100000:2.0:1789776367.464217:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.464242:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ffbdcd going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.464255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443072 00000100:00100000:2.0:1789776367.464259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443072 00100000:10000000:3.0:1789776367.464308:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789776367.464424:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:2.0:1789776367.464557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776367.465668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054b71b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1876716449443072:12345-0@lo:1000: 00000100:00100000:0.0:1789776367.466776:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000652678bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1876716449441920:12345-0@lo:700: Request processed in 21629us (22484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.466787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789776367.467347:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000629b4dfb x1876716449441920/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789776383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776367.467361:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000629b4dfb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876716449441920:0@lo:700: 40000000:02000000:2.0:1789776367.467376:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1789776367.467798:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789776367.468052:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789776367.468198:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789776367.468306:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789776367.468460:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789776367.468621:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789776367.468773:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789776367.468906:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:1.0:1789776367.469895:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789776367.469977:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1789776367.470260:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789776367.470409:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789776367.470599:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789776367.470740:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789776367.473855:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000001:00080000:0.0:1789776367.479837:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789776367.480070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054b71b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1876716449443072:12345-0@lo:1000: Request processed in 14407us (15848us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789776367.480084:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00100000:10000000:3.0:1789776367.480176:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000004:00080000:0.0:1789776367.480269:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789776367.480275:0:7463:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789776367.480290:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf77a48c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876716449443072:0@lo:1000: 00100000:10000000:3.0:1789776367.485516:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789776367.485708:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789776367.485861:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789776367.486238:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789776367.486444:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789776367.486762:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789776367.486896:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789776367.487172:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789776367.487313:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789776367.487478:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789776367.488191:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789776367.488592:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789776367.490235:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789776367.490393:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789776367.491321:0:7445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789776367.491537:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789776367.515801:0:7445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789776367.515846:0:7445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaed6c1c8b988 00100000:10000000:3.0:1789776367.515854:0:7445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789776367.519539:0:7445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776367.519589:0:7445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776367.519618:0:7445:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789776367.519646:0:7445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789776367.520415:0:7445:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776367.520634:0:7445:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789776367.523077:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789776367.523176:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789776367.523180:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789776368.035618:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776368.418619:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00010000:00010000:3.0:1789776369.059234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776369.448292:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00010000:00010000:2.0:1789776370.082895:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776370.466871:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00010000:00010000:3.0:1789776371.109079:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789776371.369905:0:7721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789776371.490586:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00010000:00010000:0.0:1789776372.131957:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789776372.181156:0:7773:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776372.181653:0:7773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789776372.514563:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 0 seconds 00000100:00080000:2.0:1789776372.770690:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789776372.770700:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789776372.770704:0:38:0:(import.c:65:import_set_state_nolock()) 000000005d5d249f lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776372.770717:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000005d5d249f using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776372.770724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021e1e75b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449443200:0@lo:400: 00000100:00100000:2.0:1789776372.770741:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ccd4e433 x1876716449443712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776372.770775:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449443584:0@lo:400: 00000100:00100000:0.0:1789776372.770817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.770824:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.770904:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbc94b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449443328:0@lo:400: 00000100:00100000:0.0:1789776372.770911:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443200 00000100:00100000:0.0:1789776372.770920:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443200 00000100:00100000:2.0:1789776372.770938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.770963:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776372.770970:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf77a48c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449443456:0@lo:400: 00000100:00100000:0.0:1789776372.770975:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789776372.770986:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c32a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3644:x1876716449443200:12345-0@lo:400: 00000100:00100000:2.0:1789776372.771016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.771049:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449443712:0@lo:38: 00000100:00100000:0.0:1789776372.771082:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c32a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3644:x1876716449443200:12345-0@lo:400: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776372.771088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776372.771097:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776372.771129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443584 00000100:00100000:2.0:1789776372.771135:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443584 00000100:00100000:0.0:1789776372.771155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021e1e75b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449443200:0@lo:400: 00000100:00100000:2.0:1789776372.771169:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443328 00000100:00100000:2.0:1789776372.771173:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443328 00000100:00100000:2.0:1789776372.771274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776372.771282:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a19bd2fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449443584:12345-0@lo:400: 00000100:00100000:2.0:1789776372.771329:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a19bd2fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449443584:12345-0@lo:400: Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776372.771342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776372.771356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776372.771361:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ac0a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449443328:12345-0@lo:400: 00000100:00100000:2.0:1789776372.771393:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ac0a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449443328:12345-0@lo:400: Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776372.771399:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776372.771422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443456 00000100:00100000:2.0:1789776372.771425:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443456 00000100:00100000:2.0:1789776372.771442:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443712 00000100:00100000:2.0:1789776372.771445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443712 00010000:00080000:0.0:1789776372.771792:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e207c0d9 x1876716449443584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776372.771804:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207c0d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449443584:0@lo:400: 00000100:00100000:2.0:1789776372.772294:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776372.772309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b0fddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449443456:12345-0@lo:400: 00000100:00100000:2.0:1789776372.772363:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b0fddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449443456:12345-0@lo:400: Request processed in 60us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776372.772369:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776372.772383:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776372.772387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ccba2bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876716449443712:12345-0@lo:38: 00010000:00080000:2.0:1789776372.772410:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000100:00100000:3.0:1789776372.773230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf77a48c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449443456:0@lo:400: 00010000:00080000:3.0:1789776372.773247:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cbc94b2a x1876716449443328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776372.773265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbc94b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449443328:0@lo:400: 00000020:00000080:2.0:1789776372.773542:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb8846af 00000004:00100000:2.0:1789776372.773562:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789776372.773569:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789776372.773879:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776372.773896:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449443840:0@lo:41: 00000100:00100000:1.0:1789776372.774067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.774107:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789776372.774115:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789776372.774203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443840 00000100:00100000:1.0:1789776372.774208:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443840 00000100:00100000:1.0:1789776372.775959:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776372.775982:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005687ab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449443840:12345-0@lo:41: 00000004:00000024:1.0:1789776372.776034:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789776372.776179:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005687ab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449443840:12345-0@lo:41: Request processed in 205us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776372.776187:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776372.776338:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000887b98c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449443840:0@lo:41: 00000100:00080000:0.0:1789776372.795886:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000cd55bf74 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776372.796071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ccba2bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449443712:12345-0@lo:38: Request processed in 23680us (24985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.796086:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789776372.796146:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789776372.796178:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789776372.796186:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789776372.796189:0:3642:0:(import.c:65:import_set_state_nolock()) 000000005d5d249f lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789776372.796211:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c0319ef0): req@00000000b2a5cfe5 x1876716449440896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776372.796230:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccd4e433 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449443712:0@lo:38: 00000100:00100000:1.0:1789776372.796322:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.796362:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0319ef0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776372.796381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449440896 00000100:00100000:1.0:1789776372.796387:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449440896 00000100:00100000:1.0:1789776372.796425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776372.796437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4c607e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449440896:12345-0@lo:1000: 00000100:00100000:1.0:1789776372.796536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4c607e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449440896:12345-0@lo:1000: Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776372.796543:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776372.796572:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449440896:0@lo:1000: 00000040:01000000:1.0:1789776372.796603:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789776372.796643:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449443968:0@lo:1000: 00000100:00100000:1.0:1789776372.796679:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.796701:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5ca8d48 going to sleep for 11 seconds 00000100:00100000:1.0:1789776372.796715:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449443968 00000100:00100000:1.0:1789776372.796718:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449443968 00000100:00100000:1.0:1789776372.796744:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776372.796750:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071b71ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449443968:12345-0@lo:1000: 00000100:00100000:1.0:1789776372.796845:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071b71ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449443968:12345-0@lo:1000: Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776372.796852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776372.796911:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449443968:0@lo:1000: 00000100:00100000:1.0:1789776372.796950:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444096:0@lo:700: 00000100:00100000:1.0:1789776372.796974:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.797001:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbe31e86 going to sleep for 11 seconds 00000100:00100000:1.0:1789776372.797022:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444096 00000100:00100000:1.0:1789776372.797026:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444096 00000100:00100000:1.0:1789776372.797057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776372.797066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ec8b21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449444096:12345-0@lo:700: 00000100:00100000:0.0:1789776372.797074:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449444224:0@lo:41: 00000100:00100000:1.0:1789776372.797118:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ec8b21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449444096:12345-0@lo:700: Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.797119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.797129:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776372.797163:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444096:0@lo:700: 00000100:00100000:0.0:1789776372.797166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444224 00000100:00100000:0.0:1789776372.797171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444224 00000100:00100000:0.0:1789776372.797195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776372.797203:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e1c0dcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449444224:12345-0@lo:41: 00000004:00000024:0.0:1789776372.797225:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789776372.797261:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444352:0@lo:1000: 00000100:00100000:0.0:1789776372.797266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e1c0dcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449444224:12345-0@lo:41: Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.797274:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776372.797296:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776372.797308:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449444224:0@lo:41: 00000100:00100000:1.0:1789776372.797315:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000344e09ad going to sleep for 11 seconds 00000100:00100000:0.0:1789776372.797329:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444352 00000100:00100000:0.0:1789776372.797333:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444352 00000100:00100000:0.0:1789776372.797352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776372.797360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f68f777 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449444352:12345-0@lo:1000: 00000100:00100000:0.0:1789776372.797426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f68f777 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449444352:12345-0@lo:1000: Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.797434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776372.797437:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444352:0@lo:1000: 00000004:00080000:1.0:1789776372.797480:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000cbe31e86 with version 0 00000020:00100000:1.0:1789776372.797512:0:7472:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789776372.797518:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b2a5cfe5 x1876716449444608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776372.797531:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444608:0@lo:1000: 00000100:00100000:1.0:1789776372.797557:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776372.797574:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f138b355 going to sleep for 11 seconds 00000100:00100000:0.0:1789776372.798380:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444608 00000100:00100000:0.0:1789776372.798387:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444608 00000100:00100000:0.0:1789776372.798427:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776372.798434:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85b9899 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7472:x1876716449444608:12345-0@lo:1000: 00000001:00080000:0.0:1789776372.811543:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789776372.811557:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789776372.814828:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85b9899 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7472:x1876716449444608:12345-0@lo:1000: Request processed in 16385us (17261us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789776372.814846:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789776372.818375:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789776372.818387:0:7472:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789776372.818539:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2a5cfe5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444608:0@lo:1000: 00000100:00100000:2.0:1789776372.818650:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082a0235e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444736:0@lo:1000: 00000100:00100000:2.0:1789776372.818720:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.818754:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93b8b0e going to sleep for 11 seconds 00000100:00100000:0.0:1789776372.818947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444736 00000100:00100000:0.0:1789776372.818954:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444736 00000100:00100000:0.0:1789776372.819023:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789776372.819040:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca76a96b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7472:x1876716449444736:12345-0@lo:1000: 00000100:00100000:0.0:1789776372.819127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca76a96b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7472:x1876716449444736:12345-0@lo:1000: Request processed in 97us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.819135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776372.819164:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082a0235e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7472:1876716449444736:0@lo:1000: 00000040:00080000:2.0:1789776372.819181:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789776372.819207:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000091077041 with version 1 00000004:00080000:0.0:1789776372.819302:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a16fd63b version 1 rpc_version 1 00000020:00100000:0.0:1789776372.819321:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789776372.819329:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000924e9434 x1876716449444992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776372.819343:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7467:1876716449444992:0@lo:1000: 00000100:00100000:0.0:1789776372.819374:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776372.819398:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c863af1e going to sleep for 11 seconds 00000100:00100000:1.0:1789776372.819443:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449444992 00000100:00100000:1.0:1789776372.819448:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449444992 00000100:00100000:1.0:1789776372.819484:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776372.819515:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000826556cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7467:x1876716449444992:12345-0@lo:1000: 00000040:00080000:2.0:1789776372.822307:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789776372.822399:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:2.0:1789776372.822405:0:7472:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1789776372.823802:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789776372.824758:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000826556cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7467:x1876716449444992:12345-0@lo:1000: Request processed in 5263us (5379us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789776372.824777:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789776372.824942:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789776372.824948:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789776372.824966:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7467:1876716449444992:0@lo:1000: 00010000:00010000:2.0:1789776373.155612:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776374.183150:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789776374.677375:0:7876:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776374.678066:0:7876:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776375.209240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776375.506017:0:7924:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda65a860 20000000:00000080:0.0:1789776375.506041:0:7924:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cf5000000 uarg=0000000000000000 20000000:01000000:0.0:1789776375.506087:0:7924:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789776375.506095:0:7924:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789776375.506101:0:7924:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789776375.506184:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789776375.506196:0:7924:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789776375.510442:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776375.511319:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789776375.511358:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789776375.511378:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789776375.511396:0:7924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776375.511414:0:7924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511433:0:7924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511440:0:7924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884654 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511445:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511485:0:7924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511620:0:7924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776375.511647:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1876716449445120:0@lo:104: 00000100:00100000:0.0:1789776375.511713:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776375.511800:0:7924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.511808:0:7924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776375.511816:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0aa5add pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1876716449445248:0@lo:104: 00000100:00100000:0.0:1789776375.511837:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca27feaa going to sleep for 11 seconds 00000100:00100000:2.0:1789776375.511898:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789776375.511920:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776375.511956:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445120 00000100:00100000:2.0:1789776375.511963:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445120 00000100:00100000:0.0:1789776375.511972:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445248 00000100:00100000:0.0:1789776375.511978:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445248 00000100:00100000:2.0:1789776375.512007:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776375.512017:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027e7ec64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:7924:x1876716449445120:12345-0@lo:104: 00010000:00010000:2.0:1789776375.512029:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512098:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776375.512103:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027e7ec64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:7924:x1876716449445120:12345-0@lo:104: Request processed in 90us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776375.512110:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789776375.512124:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776375.512131:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.512140:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061867f02 already unused, calling callback (000000005a38c4ad) 10000000:00010000:3.0:1789776375.512143:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.512150:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776375.512155:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 10000000:00010000:3.0:1789776375.512162:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776375.512167:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082a0235e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:7924:x1876716449445248:12345-0@lo:104: 10000000:01000000:3.0:1789776375.512171:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776375.512183:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.512209:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512224:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789776375.512225:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789776375.512231:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082a0235e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:7924:x1876716449445248:12345-0@lo:104: Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776375.512237:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789776375.512249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512255:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776375.512257:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000061867f02/0xf13b8042cb884654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88465b expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.512273:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776375.512282:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776375.512283:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776375.512296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d191e9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449445376:0@lo:103: 00000100:00100000:3.0:1789776375.512333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776375.512378:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445376 00000100:00100000:3.0:1789776375.512381:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445376 00010000:00010000:3.0:1789776375.512402:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 16 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512408:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776375.512414:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512421:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000899775a8 already unused, calling callback (000000005a38c4ad) 10000000:00010000:2.0:1789776375.512424:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776375.512427:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776375.512436:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629b4dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3646:x1876716449445376:12345-0@lo:103: 00010000:00010000:2.0:1789776375.512436:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776375.512448:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.512450:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776375.512456:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 16 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776375.512456:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776375.512470:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 16 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512476:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512484:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776375.512485:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776375.512520:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776375.512537:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb88454a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884551 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776375.512541:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629b4dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3646:x1876716449445376:12345-0@lo:103: Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776375.512552:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789776375.512559:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776375.512563:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776375.512565:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776375.512573:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776375.512584:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449445504:0@lo:103: 00000100:00100000:3.0:1789776375.512593:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d191e9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449445376:0@lo:103: 00010000:00010000:3.0:1789776375.512621:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776375.512623:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776375.512632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776375.512847:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a9bfcf0/0xf13b8042cb88465b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884654 expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776375.512919:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000924e9434 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1876716449445120:0@lo:104: 00000100:00100000:0.0:1789776375.512929:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0aa5add pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1876716449445248:0@lo:104: 00010000:00010000:0.0:1789776375.512954:0:7924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776375.513734:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445504 00000100:00100000:3.0:1789776375.513743:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445504 00010000:00010000:3.0:1789776375.513765:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776375.513816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776375.513824:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002568e30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3644:x1876716449445504:12345-0@lo:103: 00010000:00010000:3.0:1789776375.513835:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776375.513838:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513848:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513861:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd32a88f/0xf13b8042cb884551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88454a expref: 15 pid: 6510 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513875:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513883:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513897:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513903:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513908:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513914:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513929:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005eabd287 already unused, calling callback (000000004c80d481) 00010000:00010000:3.0:1789776375.513932:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513948:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513966:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.513977:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776375.513984:0:7924:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.513994:0:7924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.514001:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005eabd287/0xf13b8042cb8846b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776375.514037:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002568e30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:3644:x1876716449445504:12345-0@lo:103: Request processed in 213us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776375.514046:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776375.514296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ace02179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449445504:0@lo:103: 10000000:01000000:1.0:1789776375.858738:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776375.858747:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cd0f5c800 from 4 10000000:01000000:1.0:1789776375.858751:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776375.858796:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.858807:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.858816:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.858837:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445632:0@lo:101: 00000100:00100000:1.0:1789776375.858897:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.858954:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad5293d going to sleep for 11 seconds 00000100:00100000:3.0:1789776375.859033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445632 00000100:00100000:3.0:1789776375.859041:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445632 00000100:00100000:3.0:1789776375.859100:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789776375.859108:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035c54dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:6514:x1876716449445632:12345-0@lo:101: 00010000:00010000:3.0:1789776375.859121:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776375.859133:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006a730a3/0xf13b8042cb8846c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8846bd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.859153:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006a730a3/0xf13b8042cb8846c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.859163:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006a730a3/0xf13b8042cb8846c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776375.859170:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006a730a3, rc 0) 00000100:00100000:3.0:1789776375.859386:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035c54dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449445632:12345-0@lo:101: Request processed in 279us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776375.859394:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789776375.861692:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445632:0@lo:101: 00010000:00010000:1.0:1789776375.861725:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.861737:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.861819:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445760:0@lo:256: 00000100:00100000:1.0:1789776375.861880:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.861956:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad5293d going to sleep for 11 seconds 00000100:00100000:2.0:1789776375.862096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445760 00000100:00100000:2.0:1789776375.862104:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445760 00000100:00100000:2.0:1789776375.862253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776375.862263:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a53442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449445760:12345-0@lo:256: 20000000:01000000:2.0:1789776375.862286:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776375.862304:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776375.862307:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789776375.862407:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a53442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449445760:12345-0@lo:256: Request processed in 145us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776375.862414:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776375.862489:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445760:0@lo:256: 10000000:01000000:1.0:1789776375.862555:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776375.862561:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.862569:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000899775a8/0xf13b8042cb8846bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776375.862579:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776375.862581:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cd0f5c800 from 1 10000000:01000000:1.0:1789776375.862584:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776375.862608:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000d09739c9/0xf13b8042cb8846cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.862615:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000d09739c9/0xf13b8042cb8846cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.862622:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000d09739c9/0xf13b8042cb8846cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.862635:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445888:0@lo:101: 00000100:00100000:1.0:1789776375.862661:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.865222:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad5293d going to sleep for 11 seconds 00000100:00100000:0.0:1789776375.865706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449445888 00000100:00100000:0.0:1789776375.865718:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449445888 00000100:00100000:0.0:1789776375.865765:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776375.865773:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a042a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449445888:12345-0@lo:101: 00010000:00010000:0.0:1789776375.865790:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776375.865811:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005eabd287/0xf13b8042cb8846d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8846cb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.865840:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eabd287/0xf13b8042cb8846d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.865850:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005eabd287/0xf13b8042cb8846d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776375.865860:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005eabd287, rc 0) 00000100:00100000:0.0:1789776375.865945:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a042a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449445888:12345-0@lo:101: Request processed in 172us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776375.865952:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789776375.866121:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449445888:0@lo:101: 00010000:00010000:1.0:1789776375.866145:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000d09739c9/0xf13b8042cb8846cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.866154:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000d09739c9/0xf13b8042cb8846cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.866258:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446016:0@lo:501: 00000100:00100000:1.0:1789776375.866292:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.866323:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad5293d going to sleep for 11 seconds 00000100:00100000:0.0:1789776375.866456:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446016 00000100:00100000:0.0:1789776375.866460:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446016 00000100:00100000:0.0:1789776375.866481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789776375.866486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049588e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449446016:12345-0@lo:501: 00000100:00100000:0.0:1789776375.866619:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049588e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449446016:12345-0@lo:501: Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776375.866626:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789776375.866697:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446016:0@lo:501: 00000100:00100000:1.0:1789776375.866724:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446144:0@lo:503: 00000100:00100000:1.0:1789776375.866760:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.866786:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad5293d going to sleep for 11 seconds 00000100:00100000:0.0:1789776375.866838:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446144 00000100:00100000:0.0:1789776375.866843:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446144 00000100:00100000:0.0:1789776375.866867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776375.866873:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f79da807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449446144:12345-0@lo:503: 00000100:00100000:0.0:1789776375.866961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f79da807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449446144:12345-0@lo:503: Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776375.866968:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789776375.867173:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446144:0@lo:503: 00000100:00100000:1.0:1789776375.867576:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7937:1876716449446272:0@lo:502: 00000100:00100000:1.0:1789776375.867614:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.867642:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5ca8d48 going to sleep for 11 seconds 00000100:00100000:0.0:1789776375.867692:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446272 00000100:00100000:0.0:1789776375.867697:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446272 00000100:00100000:0.0:1789776375.867717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776375.867723:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037691507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7937:x1876716449446272:12345-0@lo:502: 00000100:00100000:0.0:1789776375.867807:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037691507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7937:x1876716449446272:12345-0@lo:502: Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776375.867813:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776375.869111:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002db0b511 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7937:1876716449446272:0@lo:502: 00000020:01000000:1.0:1789776375.869145:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776375.869156:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776375.869158:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789776375.869168:0:7937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cd0f5c800 00000020:00000080:1.0:1789776375.869171:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776375.869220:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7937:1876716449446400:0@lo:502: 00000100:00100000:1.0:1789776375.869272:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.869305:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.869340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446400 00000100:00100000:1.0:1789776375.869346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446400 00000100:00100000:1.0:1789776375.869377:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776375.869385:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7937:x1876716449446400:12345-0@lo:502: 00000100:00100000:1.0:1789776375.869511:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:7937:x1876716449446400:12345-0@lo:502: Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.869519:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776375.869560:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7937:1876716449446400:0@lo:502: 00000020:01000000:1.0:1789776375.869579:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776375.869583:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776375.869585:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789776375.869589:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789776375.869715:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789776375.869737:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776375.869747:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.869758:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776375.869769:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776375.869771:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cdb443800 from 4 10000000:01000000:1.0:1789776375.869774:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776375.869799:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.869808:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.869818:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.869831:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446528:0@lo:101: 00000100:00100000:1.0:1789776375.869869:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.869885:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.869897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446528 00000100:00100000:1.0:1789776375.869900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446528 00000100:00100000:1.0:1789776375.869919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776375.869925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449446528:12345-0@lo:101: 00010000:00010000:1.0:1789776375.869943:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776375.869955:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8846d9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.869975:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.869994:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870002:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d02044c00, rc 0) 00000100:00100000:1.0:1789776375.870031:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449446528:12345-0@lo:101: Request processed in 107us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.870037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776375.870066:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446528:0@lo:101: 00010000:00010000:1.0:1789776375.870078:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870087:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.870127:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446656:0@lo:256: 00000100:00100000:1.0:1789776375.870167:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.870181:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.870192:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446656 00000100:00100000:1.0:1789776375.870196:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446656 00000100:00100000:1.0:1789776375.870213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776375.870218:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449446656:12345-0@lo:256: 20000000:01000000:1.0:1789776375.870231:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776375.870244:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776375.870248:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789776375.870321:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449446656:12345-0@lo:256: Request processed in 102us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.870328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776375.870356:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446656:0@lo:256: 10000000:01000000:1.0:1789776375.870391:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776375.870396:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870404:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776375.870412:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776375.870413:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cdb443800 from 1 10000000:01000000:1.0:1789776375.870416:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776375.870430:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870437:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870455:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.870466:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446784:0@lo:101: 00000100:00100000:1.0:1789776375.870525:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.870537:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.870548:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446784 00000100:00100000:1.0:1789776375.870552:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446784 00000100:00100000:1.0:1789776375.870568:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776375.870574:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449446784:12345-0@lo:101: 00010000:00010000:1.0:1789776375.870581:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776375.870590:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8846e7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870603:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870611:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870618:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d02045e00, rc 0) 00000100:00100000:1.0:1789776375.870646:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449446784:12345-0@lo:101: Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.870653:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776375.870680:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446784:0@lo:101: 00010000:00010000:1.0:1789776375.870689:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.870707:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776375.870750:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446912:0@lo:501: 00000100:00100000:1.0:1789776375.870773:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.870786:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.870797:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449446912 00000100:00100000:1.0:1789776375.870800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449446912 00000100:00100000:1.0:1789776375.870817:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789776375.870822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449446912:12345-0@lo:501: 00000100:00100000:1.0:1789776375.870918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449446912:12345-0@lo:501: Request processed in 94us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.870924:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789776375.870965:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449446912:0@lo:501: 00000100:00100000:1.0:1789776375.870987:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449447040:0@lo:503: 00000100:00100000:1.0:1789776375.871018:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.871031:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.871041:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447040 00000100:00100000:1.0:1789776375.871044:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447040 00000100:00100000:1.0:1789776375.871059:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776375.871065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449447040:12345-0@lo:503: 00000100:00100000:1.0:1789776375.871130:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449447040:12345-0@lo:503: Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.871136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776375.871171:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449447040:0@lo:503: 00000100:00100000:1.0:1789776375.871364:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7938:1876716449447168:0@lo:502: 00000100:00100000:1.0:1789776375.871395:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.871412:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447168 00000100:00100000:1.0:1789776375.871416:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447168 00000100:00100000:1.0:1789776375.871436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789776375.871441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7938:x1876716449447168:12345-0@lo:502: 00000100:00100000:1.0:1789776375.871529:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7938:x1876716449447168:12345-0@lo:502: Request processed in 87us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.871536:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789776375.871561:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.871573:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7938:1876716449447168:0@lo:502: 00000020:01000000:1.0:1789776375.871591:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776375.871599:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776375.871601:0:7938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789776375.871609:0:7938:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cdb443800 00000020:00000080:1.0:1789776375.871611:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776375.871630:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7938:1876716449447296:0@lo:502: 00000100:00100000:1.0:1789776375.871662:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776375.871680:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447296 00000100:00100000:1.0:1789776375.871683:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447296 00000100:00100000:1.0:1789776375.871699:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789776375.871705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7938:x1876716449447296:12345-0@lo:502: 00000100:00100000:1.0:1789776375.871761:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:7938:x1876716449447296:12345-0@lo:502: Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776375.871767:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789776375.871793:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776375.871805:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:7938:1876716449447296:0@lo:502: 00000020:01000000:1.0:1789776375.871827:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776375.871830:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776375.871832:0:7938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789776375.871836:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789776375.871877:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789776375.871891:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776375.871898:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776375.872974:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776376.228961:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776377.250729:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776377.890669:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449447808:0@lo:400: 00000100:00100000:3.0:1789776377.890693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449447424:0@lo:400: 00000100:00100000:2.0:1789776377.890739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776377.890745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776377.890789:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449447936:0@lo:41: 00000100:00100000:2.0:1789776377.890810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449447680:0@lo:400: 00000100:00100000:3.0:1789776377.890822:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776377.890858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776377.890860:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449447552:0@lo:400: 00000100:00100000:3.0:1789776377.890905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776377.890910:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447936 00000100:00100000:2.0:1789776377.890917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447936 00000100:00100000:3.0:1789776377.890929:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449448064:0@lo:400: 00000100:00100000:3.0:1789776377.890957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776377.891003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447808 00000100:00100000:1.0:1789776377.891009:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447808 00000100:00100000:1.0:1789776377.891039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447552 00000100:00100000:1.0:1789776377.891043:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447552 00000100:00100000:1.0:1789776377.891061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776377.891069:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449447808:12345-0@lo:400: 00000100:00100000:1.0:1789776377.891126:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449447808:12345-0@lo:400: Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.891134:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776377.891151:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776377.891156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449447552:12345-0@lo:400: 00000100:00100000:1.0:1789776377.891183:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449447552:12345-0@lo:400: Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.891189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776377.891206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447424 00000100:00100000:1.0:1789776377.891209:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447424 00000100:00100000:1.0:1789776377.891242:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789776377.891249:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3644:x1876716449447424:12345-0@lo:400: 00000100:00100000:1.0:1789776377.891285:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3644:x1876716449447424:12345-0@lo:400: Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.891291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789776377.891554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449447680 00000100:00100000:2.0:1789776377.891559:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449447680 00010000:00080000:3.0:1789776377.891589:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cc81f4000 x1876716449447552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776377.891590:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448064 00000100:00100000:2.0:1789776377.891595:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448064 00000100:00100000:3.0:1789776377.891609:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449447552:0@lo:400: 00000100:00100000:2.0:1789776377.891615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776377.891623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876716449447936:12345-0@lo:41: 00000100:00100000:3.0:1789776377.891628:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776377.891637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449448192:0@lo:41: 00000004:00000024:2.0:1789776377.891653:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789776377.891667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776377.891701:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876716449447936:12345-0@lo:41: Request processed in 78us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776377.891709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776377.891721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448192 00000100:00100000:2.0:1789776377.891724:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448192 00000100:00100000:2.0:1789776377.891740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776377.891746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449447680:12345-0@lo:400: 00000100:00100000:1.0:1789776377.891759:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776377.891770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449448064:12345-0@lo:400: 00000100:00100000:2.0:1789776377.891779:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449447680:12345-0@lo:400: Request processed in 32us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776377.891787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776377.891803:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776377.891811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449448192:12345-0@lo:41: 00000004:00000024:2.0:1789776377.891827:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789776377.891866:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449448064:12345-0@lo:400: Request processed in 98us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776377.891868:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449448192:12345-0@lo:41: Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.891881:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776377.891889:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789776377.891924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449447424:0@lo:400: 00000100:00100000:1.0:1789776377.891943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449447936:0@lo:41: 00000100:00100000:3.0:1789776377.892002:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449448064:0@lo:400: 00000100:00100000:2.0:1789776377.892017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449447680:0@lo:400: 00000100:00100000:3.0:1789776377.892028:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449448192:0@lo:41: 00010000:00080000:2.0:1789776377.892053:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cc81f7480 x1876716449447808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776377.892063:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449447808:0@lo:400: 00010000:00010000:3.0:1789776378.274583:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776379.300103:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776380.323692:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776381.346597:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776382.374690:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789776383.010887:0:8425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789776383.010892:0:8425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789776383.010893:0:8425:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789776383.011057:0:8425:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5cfc247800 00000020:01000004:2.0:1789776383.011073:0:8425:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789776383.011085:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789776383.011100:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a5cfc0d0000) 00000020:00000080:2.0:1789776383.011117:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1789776383.012176:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449448320:0@lo:41: 00000100:00100000:3.0:1789776383.012244:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.012678:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449448448:0@lo:400: 00000100:00100000:1.0:1789776383.012721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.012756:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776383.012762:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449448832:0@lo:400: 00000100:00100000:1.0:1789776383.012791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.012836:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448320 00000100:00100000:1.0:1789776383.012842:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448320 00000100:00100000:1.0:1789776383.012901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776383.012910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449448320:12345-0@lo:41: 00000004:00000024:1.0:1789776383.012948:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789776383.012992:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449448320:12345-0@lo:41: Request processed in 83us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.013000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776383.013031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449448576:0@lo:400: 00000100:00100000:1.0:1789776383.013061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.013082:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776383.013087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449448704:0@lo:400: 00000100:00100000:1.0:1789776383.013109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.013137:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448448 00000100:00100000:1.0:1789776383.013141:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448448 00000100:00100000:1.0:1789776383.013166:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789776383.013172:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3644:x1876716449448448:12345-0@lo:400: 00000100:00100000:1.0:1789776383.013414:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3644:x1876716449448448:12345-0@lo:400: Request processed in 241us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.013422:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789776383.013450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448832 00000100:00100000:1.0:1789776383.013453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448832 00000100:00100000:1.0:1789776383.013485:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448576 00000100:00100000:1.0:1789776383.013488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448576 00000100:00100000:1.0:1789776383.013522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776383.013528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449448832:12345-0@lo:400: 00000100:00100000:1.0:1789776383.013560:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449448832:12345-0@lo:400: Request processed in 32us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.013565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776383.013576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776383.013582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449448576:12345-0@lo:400: 00000100:00100000:1.0:1789776383.013612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449448576:12345-0@lo:400: Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.013618:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776383.013634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448704 00000100:00100000:1.0:1789776383.013645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448704 00000100:00100000:1.0:1789776383.013666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776383.013671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449448704:12345-0@lo:400: 00000100:00100000:1.0:1789776383.013700:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449448704:12345-0@lo:400: Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.013705:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776383.013755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449448704:0@lo:400: 00010000:00080000:1.0:1789776383.013768:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cf0f71f80 x1876716449448576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776383.013777:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449448576:0@lo:400: 00000100:00100000:1.0:1789776383.013813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449448960:0@lo:41: 00000100:00100000:1.0:1789776383.013837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789776383.014269:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cf0f73480 x1876716449448832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776383.014280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449448832:0@lo:400: 00000100:00100000:1.0:1789776383.014290:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449448448:0@lo:400: 00000100:00100000:1.0:1789776383.014313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449448960 00000100:00100000:1.0:1789776383.014316:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449448960 00000100:00100000:1.0:1789776383.014812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776383.014822:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449448960:12345-0@lo:41: 00000004:00000024:1.0:1789776383.014884:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789776383.014931:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449448960:12345-0@lo:41: Request processed in 112us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.014937:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776383.015124:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449448320:0@lo:41: 00000100:00100000:1.0:1789776383.021719:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449448960:0@lo:41: 00100000:10000000:0.0:1789776383.061248:0:8425:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789776383.061309:0:8425:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789776383.088408:0:8425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789776383.088687:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789776383.088699:0:8425:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789776383.088708:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf13b8042cb8846fc 00000020:01000004:0.0:1789776383.088714:0:8425:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789776383.088734:0:8425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789776383.088737:0:8425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789776383.088745:0:8425:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789776383.088749:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789776383.088768:0:8425:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a5cf5dd3370) 00000020:00000080:0.0:1789776383.088778:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789776383.097658:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776383.098043:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789776383.098055:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789776383.102830:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789776383.102846:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789776383.103272:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776383.103279:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789776383.105061:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776383.105285:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789776383.105291:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789776383.107072:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789776383.107085:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789776383.127913:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776383.128275:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789776383.128284:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789776383.129644:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776383.129655:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789776383.131033:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789776383.131046:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789776383.133479:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776383.134041:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789776383.134050:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789776383.134704:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789776383.134710:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789776383.172426:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776383.172824:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789776383.172832:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789776383.174212:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789776383.174222:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789776383.174784:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789776383.174824:0:8425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789776383.174831:0:8425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789776383.194528:0:8425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789776383.196392:0:8425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789776383.196400:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789776383.196401:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789776383.196403:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776383.196416:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776383.196417:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776383.196419:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776383.196420:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776383.196422:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776383.196423:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776383.196425:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776383.196426:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776383.196431:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789776383.196434:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776383.196436:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789776383.196437:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776383.196438:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776383.196438:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776383.196439:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776383.196440:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776383.196441:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776383.196442:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776383.196443:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776383.196444:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776383.196472:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789776383.196506:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449449088:0@lo:253: 00000100:00100000:2.0:1789776383.196583:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.196637:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776383.196646:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449088 00000100:00100000:0.0:1789776383.196654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449088 00000100:00100000:0.0:1789776383.196713:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776383.196723:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:8425:x1876716449449088:12345-0@lo:253: 20000000:01000000:0.0:1789776383.196764:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789776383.196768:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789776383.196773:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789776383.196776:0:6511:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789776383.197202:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776383.197377:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789776383.197394:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789776383.197409:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789776383.197414:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789776383.197424:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789776383.197436:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789776383.197691:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789776383.197708:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1789776383.197710:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1789776383.197723:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789776383.197728:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789776383.197740:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789776383.197746:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1789776383.197773:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789776383.197783:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789776383.197811:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789776383.197829:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789776383.198148:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789776383.198162:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1789776383.198170:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1789776383.198186:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789776383.198193:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789776383.198204:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789776383.198209:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1789776383.198219:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789776383.198224:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789776383.198236:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789776383.198251:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789776383.198652:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789776383.198665:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1789776383.198667:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1789776383.198681:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789776383.198687:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789776383.198700:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789776383.198706:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1789776383.198719:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789776383.198726:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789776383.198738:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789776383.198753:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789776383.198765:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789776383.198768:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789776383.198772:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789776383.198848:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789776383.198852:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789776383.199579:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789776383.199609:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789776383.199627:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789776383.199827:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789776383.199934:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789776383.199955:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789776383.200047:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789776383.200050:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789776383.200419:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789776383.200634:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789776383.200653:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789776383.200677:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789776383.200685:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789776383.200687:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789776383.201252:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789776383.201283:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789776383.201297:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789776383.201471:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789776383.201689:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789776383.201713:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789776383.201725:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789776383.201727:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789776383.202204:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789776383.202229:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789776383.202244:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789776383.202410:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789776383.202429:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789776383.202442:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1789776383.202457:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789776383.202475:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202632:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202643:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88460e expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202650:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884646 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202656:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884662 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202662:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88469a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202669:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202721:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.202736:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 18 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.202753:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449216:0@lo:104: 00000100:00100000:0.0:1789776383.202833:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776383.203017:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.203026:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 18 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.203034:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449344:0@lo:104: 00000100:00100000:0.0:1789776383.203056:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776383.203344:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.203354:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 18 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.203362:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449472:0@lo:104: 00000100:00100000:0.0:1789776383.203388:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.203453:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449216 00000100:00100000:2.0:1789776383.203461:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449216 00000100:00100000:2.0:1789776383.203524:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449344 00000100:00100000:2.0:1789776383.203527:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449344 00000100:00100000:2.0:1789776383.203543:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776383.203552:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6511:x1876716449449216:12345-0@lo:104: 00010000:00010000:2.0:1789776383.203564:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203631:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776383.203639:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6511:x1876716449449216:12345-0@lo:104: Request processed in 88us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.203646:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776383.203664:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776383.203671:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449344:12345-0@lo:104: 00010000:00010000:2.0:1789776383.203677:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203711:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776383.203716:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449344:12345-0@lo:104: Request processed in 47us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.203721:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789776383.203739:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776383.203745:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203752:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217e200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776383.203756:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203765:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776383.203773:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776383.203779:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776383.203827:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203835:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776383.203855:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203871:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217e200/0xf13b8042cb88469a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203885:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776383.203888:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203894:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf0000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776383.203897:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203904:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776383.203911:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776383.203915:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776383.203929:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203935:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776383.203941:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203972:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0000/0xf13b8042cb884662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884669 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.203982:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776383.203984:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776383.203986:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776383.204009:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449449600:0@lo:103: 00000100:00100000:2.0:1789776383.204038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.204059:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776383.204064:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449449728:0@lo:103: 00000100:00100000:2.0:1789776383.204083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.204120:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449600 00000100:00100000:2.0:1789776383.204124:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449600 00010000:00010000:2.0:1789776383.204143:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 19 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.204162:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449728 00000100:00100000:2.0:1789776383.204165:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449728 00010000:00010000:2.0:1789776383.204174:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 20 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.204192:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776383.204199:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3645:x1876716449449600:12345-0@lo:103: 00010000:00010000:2.0:1789776383.204210:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776383.204215:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 20 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.204226:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 20 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.204248:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776383.204276:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3645:x1876716449449600:12345-0@lo:103: Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.204283:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776383.204296:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776383.204302:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3645:x1876716449449728:12345-0@lo:103: 00010000:00010000:2.0:1789776383.204310:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776383.204314:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 19 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.204323:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 19 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.204332:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776383.204351:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3645:x1876716449449728:12345-0@lo:103: Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.204357:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776383.204391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449449728:0@lo:103: 00000100:00100000:2.0:1789776383.204401:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449449600:0@lo:103: 00010000:00010000:3.0:1789776383.204744:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776383.204954:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.205022:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 18 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.205043:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449856:0@lo:104: 00000100:00100000:0.0:1789776383.205074:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776383.205180:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.205188:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 18 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.205196:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449984:0@lo:104: 00000100:00100000:0.0:1789776383.205215:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.205234:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449472 00000100:00100000:1.0:1789776383.205240:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449472 00000100:00100000:1.0:1789776383.205268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449856 00000100:00100000:1.0:1789776383.205270:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449856 00000100:00100000:1.0:1789776383.205283:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776383.205290:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6511:x1876716449449472:12345-0@lo:104: 00010000:00010000:1.0:1789776383.205299:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.205348:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776383.205353:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6511:x1876716449449472:12345-0@lo:104: Request processed in 65us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.205359:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776383.205389:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776383.205395:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449856:12345-0@lo:104: 00010000:00010000:1.0:1789776383.205402:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.205434:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776383.205439:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449856:12345-0@lo:104: Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.205444:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789776383.205585:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776383.205591:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205599:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776383.205603:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205611:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776383.205617:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776383.205623:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776383.205649:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205655:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776383.205671:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205677:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88464d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205704:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776383.205708:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205713:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d02045c00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776383.205716:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205723:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776383.205729:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776383.205735:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776383.205749:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205754:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776383.205760:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205766:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d02045c00/0xf13b8042cb88460e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884615 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.205776:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.205777:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.205779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776383.205802:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449450112:0@lo:103: 00000100:00100000:3.0:1789776383.205837:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.205874:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776383.205881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449450240:0@lo:103: 00000100:00100000:3.0:1789776383.205904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.205931:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450112 00000100:00100000:3.0:1789776383.205935:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450112 00010000:00010000:3.0:1789776383.205952:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 19 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776383.205985:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450240 00000100:00100000:3.0:1789776383.205988:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450240 00010000:00010000:3.0:1789776383.206000:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 20 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776383.206017:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776383.206023:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3643:x1876716449450112:12345-0@lo:103: 00010000:00010000:3.0:1789776383.206032:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776383.206036:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 20 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.206045:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 20 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.206059:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776383.206085:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3643:x1876716449450112:12345-0@lo:103: Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.206091:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776383.206104:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776383.206109:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3643:x1876716449450240:12345-0@lo:103: 00010000:00010000:3.0:1789776383.206124:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776383.206129:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 19 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.206138:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 19 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.206148:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776383.206171:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3643:x1876716449450240:12345-0@lo:103: Request processed in 62us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.206177:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776383.206220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449450240:0@lo:103: 00000100:00100000:3.0:1789776383.206227:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449450112:0@lo:103: 00010000:00010000:2.0:1789776383.206473:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776383.206680:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00010000:00010000:0.0:1789776383.206696:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc256200/0xf13b8042cb8846a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88469a expref: 18 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.206706:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449216:0@lo:104: 00010000:00010000:0.0:1789776383.206715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf0600/0xf13b8042cb884669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884662 expref: 17 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.206723:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449344:0@lo:104: 00010000:00010000:0.0:1789776383.206732:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf1400/0xf13b8042cb88464d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884646 expref: 16 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.206741:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449472:0@lo:104: 00010000:00010000:0.0:1789776383.206748:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb884615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88460e expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.206755:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449856:0@lo:104: 00000100:00100000:1.0:1789776383.206804:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449449984 00000100:00100000:1.0:1789776383.206808:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449449984 00000100:00100000:1.0:1789776383.206923:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776383.206932:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449984:12345-0@lo:104: 00010000:00010000:1.0:1789776383.206941:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.207063:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776383.207069:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6511:x1876716449449984:12345-0@lo:104: Request processed in 139us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.207075:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789776383.207119:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776383.207125:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207132:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ee00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776383.207136:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207143:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776383.207150:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776383.207155:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776383.207182:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207193:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776383.207209:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207216:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217ee00/0xf13b8042cb8845cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8845d6 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207231:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.207233:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.207235:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776383.207241:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776383.207252:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449450368:0@lo:103: 00000100:00100000:3.0:1789776383.207286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.207318:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450368 00000100:00100000:3.0:1789776383.207322:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450368 00010000:00010000:3.0:1789776383.207337:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 15 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776383.207356:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776383.207363:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfae82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3646:x1876716449450368:12345-0@lo:103: 00010000:00010000:3.0:1789776383.207371:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776383.207376:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 15 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207384:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 15 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207398:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207418:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207434:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207441:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207448:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207454:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207459:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030e00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776383.207463:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207469:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207477:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.207485:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776383.207539:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfae82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3646:x1876716449450368:12345-0@lo:103: Request processed in 176us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.207545:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776383.207599:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449450368:0@lo:103: 00010000:00010000:0.0:1789776383.207754:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d02045200/0xf13b8042cb8845d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8845cf expref: 14 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.207764:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1876716449449984:0@lo:104: 00010000:00010000:0.0:1789776383.207785:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.207808:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.207814:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.207819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb88470a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776383.207831:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789776383.210081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:8425:x1876716449449088:12345-0@lo:253: Request processed in 13351us (13489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776383.210095:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776383.210293:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449449088:0@lo:253: 10000000:01000000:3.0:1789776383.210307:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789776383.210310:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776383.210312:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776383.210313:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776383.210314:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789776383.210316:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776383.210317:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776383.210319:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776383.210321:0:8425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789776383.210322:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776383.210323:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776383.210344:0:8425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5cfc247800 from lustre-OST0000 10000000:01000000:3.0:1789776383.210373:0:8425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789776383.210376:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789776383.210384:0:8425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5cc8c63370 local copy 10000000:01000000:3.0:1789776383.210389:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789776383.210422:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.210433:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.210442:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776383.210461:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450496:0@lo:101: 00000100:00100000:3.0:1789776383.210856:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.210998:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.211092:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450496 00000100:00100000:1.0:1789776383.211099:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450496 00000100:00100000:1.0:1789776383.211231:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789776383.211241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:8425:x1876716449450496:12345-0@lo:101: 00010000:00010000:1.0:1789776383.211255:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776383.211270:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb884718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884711 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.211294:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb884718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884711 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.211303:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb884718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884711 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.211312:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0600, rc 0) 00000100:00100000:1.0:1789776383.211449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449450496:12345-0@lo:101: Request processed in 209us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.211456:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776383.211669:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450496:0@lo:101: 00010000:00010000:2.0:1789776383.211685:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.211695:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.211823:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450624:0@lo:501: 00000100:00100000:2.0:1789776383.211854:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.212259:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.212329:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450624 00000100:00100000:3.0:1789776383.212334:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450624 00000100:00100000:3.0:1789776383.212360:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789776383.212375:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449450624:12345-0@lo:501: 00000100:00100000:3.0:1789776383.212452:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449450624:12345-0@lo:501: Request processed in 77us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776383.212459:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789776383.212542:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450624:0@lo:501: 10000000:01000000:2.0:1789776383.212555:0:8425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789776383.212572:0:8425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789776383.212578:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.212586:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.212593:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.212610:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776383.212633:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5cfc247800 10000000:01000000:2.0:1789776383.212638:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776383.212642:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789776383.212645:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776383.212649:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789776383.212652:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776383.212669:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.212676:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.212693:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.212706:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450752:0@lo:101: 00000100:00100000:2.0:1789776383.212732:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.212743:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1480 going to sleep for 11 seconds 00010000:00010000:3.0:1789776383.212809:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776383.212815:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.212823:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776383.212827:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.212835:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776383.212841:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776383.212847:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776383.212877:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.212883:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776383.212905:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.212912:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb884711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb884718 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.212923:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.212930:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776383.212932:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776383.212938:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776383.212948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449450880:0@lo:103: 00000100:00100000:3.0:1789776383.212985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.213016:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450880 00000100:00100000:3.0:1789776383.213020:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450880 00000100:00100000:3.0:1789776383.213049:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776383.213055:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:3645:x1876716449450880:12345-0@lo:103: 00010000:00010000:3.0:1789776383.213065:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776383.213078:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb884718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884711 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.213091:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776383.213329:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:3645:x1876716449450880:12345-0@lo:103: Request processed in 273us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.213336:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776383.213356:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449450752 00000100:00100000:3.0:1789776383.213360:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449450752 00000100:00100000:3.0:1789776383.213375:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789776383.213381:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+13:8425:x1876716449450752:12345-0@lo:101: 00010000:00010000:3.0:1789776383.213390:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776383.213402:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88471f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.213419:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88471f expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.213428:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88471f expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.213442:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256c00, rc 0) 00000100:00100000:3.0:1789776383.213484:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449450752:12345-0@lo:101: Request processed in 101us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.213515:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789776383.213552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449450880:0@lo:103: 00000100:00100000:2.0:1789776383.213670:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449450752:0@lo:101: 00010000:00010000:2.0:1789776383.213682:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.213690:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.213758:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451008:0@lo:501: 00000100:00100000:2.0:1789776383.213784:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.213820:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.214125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451008 00000100:00100000:3.0:1789776383.214130:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451008 00000100:00100000:3.0:1789776383.214150:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789776383.214156:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451008:12345-0@lo:501: 00000100:00100000:3.0:1789776383.214260:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451008:12345-0@lo:501: Request processed in 103us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.214266:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789776383.214331:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451008:0@lo:501: 00000100:00100000:2.0:1789776383.214357:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451136:0@lo:503: 00000100:00100000:2.0:1789776383.214397:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.214418:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.214589:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451136 00000100:00100000:3.0:1789776383.214593:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451136 00000100:00100000:3.0:1789776383.214612:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789776383.214618:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451136:12345-0@lo:503: 00000100:00100000:3.0:1789776383.214703:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451136:12345-0@lo:503: Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.214709:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789776383.214799:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451136:0@lo:503: 00000040:00080000:2.0:1789776383.215059:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776383.215159:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451264:0@lo:502: 00000100:00100000:2.0:1789776383.215196:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.215229:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.215478:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451264 00000100:00100000:3.0:1789776383.215484:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451264 00000100:00100000:3.0:1789776383.215541:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789776383.215548:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451264:12345-0@lo:502: 00000100:00100000:3.0:1789776383.215643:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451264:12345-0@lo:502: Request processed in 95us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.215658:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789776383.216247:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451264:0@lo:502: 00000040:00080000:2.0:1789776383.216522:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789776383.216553:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789776383.216567:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789776383.216582:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789776383.216602:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789776383.216616:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789776383.216649:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451392:0@lo:502: 00000100:00100000:2.0:1789776383.216701:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.216915:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.218115:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451392 00000100:00100000:3.0:1789776383.218125:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451392 00000100:00100000:3.0:1789776383.218406:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789776383.218418:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451392:12345-0@lo:502: 00000100:00100000:3.0:1789776383.218636:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451392:12345-0@lo:502: Request processed in 219us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.218645:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789776383.218809:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451392:0@lo:502: 00000040:00080000:2.0:1789776383.218894:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789776383.218908:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789776383.219891:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776383.219900:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789776383.219906:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.219909:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789776383.219914:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776383.219929:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a5cfc0d19b8) 00000020:00000080:2.0:1789776383.219950:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789776383.219966:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789776383.220042:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5cfc247800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789776383.220051:0:8448:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789776383.220057:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf13b8042cb884734 00010000:00010000:2.0:1789776383.225482:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789776383.225804:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789776383.229404:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789776383.229877:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789776383.234696:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789776383.234945:0:8448:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789776383.241007:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789776383.242700:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789776383.242712:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776383.242718:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.242720:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789776383.242723:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776383.242727:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.242728:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789776383.242731:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789776383.242733:0:8448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789776383.242755:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776383.242758:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.242759:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789776383.242762:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789776383.245403:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789776383.245442:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789776383.245467:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.245479:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776383.245488:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cfc247800 from 1 10000000:01000000:1.0:1789776383.245508:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776383.245543:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.245550:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.245561:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776383.245583:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451520:0@lo:101: 00000100:00100000:1.0:1789776383.245649:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.245685:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776383.245784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451520 00000100:00100000:0.0:1789776383.245804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451520 00000100:00100000:0.0:1789776383.245845:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776383.245854:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:8425:x1876716449451520:12345-0@lo:101: 00010000:00010000:0.0:1789776383.247936:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776383.248224:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88473b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.248260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88473b expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.248285:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88473b expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.248294:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc0030e00, rc 0) 00000100:00100000:0.0:1789776383.248367:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8425:x1876716449451520:12345-0@lo:101: Request processed in 2513us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776383.248375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776383.248429:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451520:0@lo:101: 00010000:00010000:0.0:1789776383.248446:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.248456:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.248580:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451648:0@lo:501: 00000100:00100000:0.0:1789776383.248612:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776383.248638:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776383.248660:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451648 00000100:00100000:0.0:1789776383.248664:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451648 00000100:00100000:0.0:1789776383.248687:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776383.248694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8425:x1876716449451648:12345-0@lo:501: 00000100:00100000:1.0:1789776383.249012:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451648:0@lo:501: 00000100:00100000:1.0:1789776383.249040:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451776:0@lo:503: 00000100:00100000:1.0:1789776383.249085:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.249104:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.249120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451776 00000100:00100000:1.0:1789776383.249124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451776 00000100:00100000:1.0:1789776383.249143:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776383.249150:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449451776:12345-0@lo:503: 00000100:00100000:1.0:1789776383.249230:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449451776:12345-0@lo:503: Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.249237:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776383.249290:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451776:0@lo:503: 00000040:00080000:1.0:1789776383.249534:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776383.249597:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451904:0@lo:502: 00000100:00100000:1.0:1789776383.249635:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.249649:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.249662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449451904 00000100:00100000:1.0:1789776383.249665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449451904 00000100:00100000:1.0:1789776383.249683:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776383.249689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449451904:12345-0@lo:502: 00000100:00100000:1.0:1789776383.249762:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449451904:12345-0@lo:502: Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.249770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776383.249821:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449451904:0@lo:502: 00000040:00080000:1.0:1789776383.250157:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789776383.250182:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789776383.250203:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452032:0@lo:502: 00000100:00100000:1.0:1789776383.250236:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.250251:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.250265:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452032 00000100:00100000:1.0:1789776383.250268:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452032 00000100:00100000:1.0:1789776383.250285:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776383.250291:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452032:12345-0@lo:502: 00000100:00100000:1.0:1789776383.250353:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452032:12345-0@lo:502: Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.250365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776383.250406:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452032:0@lo:502: 00000040:00080000:1.0:1789776383.250441:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789776383.250448:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:0.0:1789776383.251051:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8425:x1876716449451648:12345-0@lo:501: Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776383.251059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000020:01000000:2.0:1789776383.251765:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776383.251774:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.251777:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789776383.251784:0:8452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cfc247800 00000020:00000080:2.0:1789776383.251786:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776383.251809:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776383.251812:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776383.251814:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789776383.251817:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789776383.251941:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789776383.252037:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776383.252054:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252064:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776383.252106:0:8425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789776383.252110:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5cfc247800 10000000:01000000:1.0:1789776383.252112:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5cfc247800 10000000:01000000:1.0:1789776383.252116:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776383.252122:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cfc247800 from 1 10000000:01000000:1.0:1789776383.252125:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776383.252155:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252162:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252171:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776383.252190:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452160:0@lo:101: 00000100:00100000:1.0:1789776383.252236:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.252278:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.252296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452160 00000100:00100000:1.0:1789776383.252302:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452160 00000100:00100000:1.0:1789776383.252339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776383.252347:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8425:x1876716449452160:12345-0@lo:101: 00010000:00010000:1.0:1789776383.252358:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776383.252370:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884749 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252391:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884749 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252401:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884749 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252409:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1800, rc 0) 00000100:00100000:1.0:1789776383.252444:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452160:12345-0@lo:101: Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.252451:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776383.252523:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452160:0@lo:101: 00010000:00010000:1.0:1789776383.252536:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776383.252545:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776383.252626:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452288:0@lo:501: 00000100:00100000:1.0:1789776383.252650:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776383.252662:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.252758:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452288 00000100:00100000:3.0:1789776383.252762:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452288 00000100:00100000:3.0:1789776383.252784:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789776383.252803:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452288:12345-0@lo:501: 00000100:00100000:3.0:1789776383.253315:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452288:12345-0@lo:501: Request processed in 523us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.253322:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776383.255104:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452288:0@lo:501: 00000100:00100000:0.0:1789776383.255156:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452416:0@lo:503: 00000100:00100000:0.0:1789776383.255220:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776383.255257:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.255304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452416 00000100:00100000:1.0:1789776383.255310:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452416 00000100:00100000:1.0:1789776383.255355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789776383.255364:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452416:12345-0@lo:503: 00000100:00100000:1.0:1789776383.255469:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452416:12345-0@lo:503: Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.255476:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776383.255626:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452416:0@lo:503: 00000040:00080000:0.0:1789776383.255940:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789776383.256079:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452544:0@lo:502: 00000100:00100000:0.0:1789776383.256119:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776383.256149:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.256196:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452544 00000100:00100000:3.0:1789776383.256201:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452544 00000100:00100000:3.0:1789776383.256234:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789776383.256242:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452544:12345-0@lo:502: 00000100:00100000:3.0:1789776383.256333:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452544:12345-0@lo:502: Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.256340:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789776383.256440:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452544:0@lo:502: 00000040:00080000:0.0:1789776383.256652:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789776383.256678:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789776383.256693:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789776383.256707:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789776383.256721:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789776383.256735:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789776383.256748:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789776383.256759:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789776383.256772:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789776383.256785:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789776383.256811:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789776383.256826:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789776383.256839:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789776383.256851:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789776383.257030:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789776383.257051:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789776383.257064:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789776383.257077:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789776383.257089:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789776383.257102:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789776383.257115:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789776383.257130:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789776383.257155:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789776383.257170:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789776383.257181:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789776383.257192:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789776383.257205:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789776383.257219:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789776383.257232:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789776383.257246:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789776383.257258:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789776383.257269:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789776383.257280:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789776383.257293:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789776383.257306:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789776383.257317:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789776383.257329:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789776383.257352:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452672:0@lo:502: 00000100:00100000:0.0:1789776383.257398:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776383.257427:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776383.257551:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452672 00000100:00100000:1.0:1789776383.257557:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452672 00000100:00100000:1.0:1789776383.257600:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789776383.257608:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452672:12345-0@lo:502: 00000100:00100000:1.0:1789776383.257704:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449452672:12345-0@lo:502: Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776383.257712:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789776383.257841:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449452672:0@lo:502: 00000040:00080000:0.0:1789776383.257947:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789776383.258024:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789776383.258831:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789776383.258846:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a5cfc0d3370) 00000020:00000080:2.0:1789776383.258933:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789776383.259073:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5cfc247800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789776383.259077:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cfc247800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789776383.259079:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cfc247800 3 00010000:00080000:2.0:1789776383.259103:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc1a61800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776383.263632:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789776383.263835:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789776383.263942:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776383.263960:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf13b8042cb88475e 00000100:00080000:2.0:1789776383.263970:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776383.263975:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a5bc1a61800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776383.264007:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cfc396680 x1876716449452800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776383.264031:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789776383.264366:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789776383.264387:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a5bc2268000) 00000020:00000080:2.0:1789776383.264400:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789776383.264459:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5cfc247800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789776383.264463:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cfc247800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789776383.264465:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cfc247800 3 00010000:00080000:2.0:1789776383.264516:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc1a67800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776383.266784:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1789776383.267016:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449452800:0@lo:38: 00000020:00000080:2.0:1789776383.267091:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000100:00100000:3.0:1789776383.267110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000010:01000000:2.0:1789776383.267134:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00100000:3.0:1789776383.267180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452800 00000100:00100000:3.0:1789776383.267187:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452800 00000100:00100000:3.0:1789776383.267229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:2.0:1789776383.267233:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf13b8042cb88476c 00000100:00100000:3.0:1789776383.267238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876716449452800:12345-0@lo:38: 00000100:00080000:2.0:1789776383.267244:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776383.267252:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a5bc1a67800 using connection 192.168.204.127@tcp/0@lo 00010000:00080000:3.0:1789776383.267267:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000100:00100000:2.0:1789776383.267283:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cfc395f80 x1876716449452928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776383.267303:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000080:3.0:1789776383.267311:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf13b8042cb884773 00000004:00100000:3.0:1789776383.267330:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776383.267363:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ceb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776383.267416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876716449452800:12345-0@lo:38: Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.267423:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776383.267455:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449452928:0@lo:38: 00000100:00100000:3.0:1789776383.267484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789776383.267549:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cfc396680 x1876716449452800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776383.267559:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776383.267566:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789776383.267573:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789776383.267578:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789776383.267580:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789776383.267586:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449452800:0@lo:38: 00000100:00100000:3.0:1789776383.267612:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449452928 00000100:00100000:3.0:1789776383.267616:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449452928 00000100:00100000:3.0:1789776383.267644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776383.267649:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449452928:12345-0@lo:38: 00010000:00080000:3.0:1789776383.267664:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1789776383.267698:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf13b8042cb88477a 00000004:00100000:3.0:1789776383.267708:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776383.267730:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5cea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776383.267775:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876716449452928:12345-0@lo:38: Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776383.267782:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789776383.267883:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cfc395f80 x1876716449452928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776383.267891:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776383.267895:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789776383.267899:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789776383.267902:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789776383.267910:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a67800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776383.267915:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449452928:0@lo:38: 00000040:00080000:2.0:1789776383.268599:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789776383.270087:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789776383.270125:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776383.270139:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776383.270151:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776383.270215:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776383.270217:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776383.270218:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776383.270219:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776383.270220:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776383.270222:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776383.270223:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776383.270225:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776383.270226:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776383.270228:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776383.270229:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776383.270232:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789776383.270235:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776383.270237:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776383.270238:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776383.270239:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776383.270240:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776383.270241:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776383.270242:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776383.270243:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776383.270244:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776383.270245:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776383.270246:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776383.270273:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789776383.270297:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449453056:0@lo:253: 00000100:00100000:3.0:1789776383.270365:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776383.270403:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776383.271105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453056 00000100:00100000:3.0:1789776383.271114:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453056 00000100:00100000:3.0:1789776383.271166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789776383.271176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449453056:12345-0@lo:253: 20000000:01000000:3.0:1789776383.271202:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789776383.271216:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789776383.279569:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789776383.279592:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789776383.279677:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789776383.279684:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789776383.279707:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.279727:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.279736:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.279759:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776383.280071:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8425:1876716449453056:0@lo:253: 00010000:00010000:0.0:1789776383.280085:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776383.280088:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789776383.280093:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776383.280096:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776383.280098:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776383.280099:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776383.280101:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776383.280103:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:0.0:1789776383.280104:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776383.280105:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776383.280108:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776383.280110:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:0.0:1789776383.280122:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449453184:0@lo:104: 00000100:00100000:2.0:1789776383.280151:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:8425:x1876716449453056:12345-0@lo:253: Request processed in 8974us (9783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.280162:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789776383.280168:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776383.280219:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280228:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776383.280236:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449453312:0@lo:104: 00000020:01000004:3.0:1789776383.280255:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1789776383.280256:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e180 going to sleep for 11 seconds 00000020:01000004:3.0:1789776383.280257:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789776383.280277:0:8425:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789776383.280282:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789776383.280300:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776383.280329:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453184 00000100:00100000:0.0:1789776383.280335:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453184 00000100:00100000:2.0:1789776383.280354:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453312 00000100:00100000:2.0:1789776383.280360:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453312 00000100:00100000:0.0:1789776383.280370:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776383.280381:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc304c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6532:x1876716449453184:12345-0@lo:104: 00010000:00010000:0.0:1789776383.280394:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280461:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776383.280467:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc304c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6532:x1876716449453184:12345-0@lo:104: Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776383.280474:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776383.280480:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449453184:0@lo:104: 00000100:00100000:0.0:1789776383.280535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776383.280542:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449453312:12345-0@lo:104: 00010000:00010000:0.0:1789776383.280550:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280601:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789776383.280607:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449453312:12345-0@lo:104: Request processed in 66us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776383.280615:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776383.280622:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449453312:0@lo:104: 00010000:00010000:0.0:1789776383.280637:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776383.280644:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280645:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280664:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d02045600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776383.280669:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280678:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776383.280685:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776383.280691:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776383.280733:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.280741:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789776383.280815:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449453440:0@lo:103: 00000100:00100000:2.0:1789776383.280846:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.280878:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453440 00000100:00100000:2.0:1789776383.280882:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453440 00010000:00010000:2.0:1789776383.280898:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.280921:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776383.280929:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3643:x1876716449453440:12345-0@lo:103: 00010000:00010000:2.0:1789776383.280939:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776383.280945:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.280968:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.280981:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d02044c00/0xf13b8042cb8846e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8846d9 expref: 16 pid: 6510 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.280995:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776383.281024:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3643:x1876716449453440:12345-0@lo:103: Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.281031:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789776383.281035:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281046:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d02045600/0xf13b8042cb8846d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281058:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776383.281062:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281068:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d02044a00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776383.281072:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.281076:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449453440:0@lo:103: 00010000:00010000:0.0:1789776383.281084:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776383.281092:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776383.281097:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776383.281130:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281136:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776383.281146:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281163:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d02044a00/0xf13b8042cb8846bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281174:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776383.281176:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776383.281177:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776383.281183:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776383.281194:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449453568:0@lo:103: 00000100:00100000:0.0:1789776383.281221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776383.281283:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453568 00000100:00100000:2.0:1789776383.281288:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453568 00010000:00010000:2.0:1789776383.281303:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776383.281334:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776383.281340:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3644:x1876716449453568:12345-0@lo:103: 00010000:00010000:2.0:1789776383.281348:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776383.281352:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281361:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281370:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb8846c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8846bd expref: 15 pid: 6509 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281390:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281397:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789776383.281409:0:7458:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002483506s 00010000:00010000:2.0:1789776383.281412:0:7458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281418:0:7458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281425:0:7458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281431:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281437:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776383.281441:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281447:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281467:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776383.281477:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776383.281529:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:3644:x1876716449453568:12345-0@lo:103: Request processed in 188us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776383.281536:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776383.281614:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449453568:0@lo:103: 00010000:00010000:0.0:1789776383.281633:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281641:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776383.281647:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb884781 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789776383.290369:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789776383.290972:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789776383.291594:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789776383.292010:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789776383.292435:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789776383.293000:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789776383.297117:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789776383.311892:0:8425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789776383.311902:0:8425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789776383.311937:0:8425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789776383.311982:0:8425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789776383.312001:0:8425:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789776383.312023:0:8425:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789776383.313655:0:8425:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776383.314248:0:8425:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789776383.396815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776384.080394:0:8509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776384.081118:0:8509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789776384.099682:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789776384.099688:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cd0f5c800 from 30 10000000:01000000:2.0:1789776384.099692:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776384.099744:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.099764:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.099783:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.099808:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453696:0@lo:101: 00000100:00100000:2.0:1789776384.099892:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.099942:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.100392:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453696 00000100:00100000:3.0:1789776384.100405:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453696 00000100:00100000:3.0:1789776384.100456:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789776384.100465:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:6514:x1876716449453696:12345-0@lo:101: 00010000:00010000:3.0:1789776384.100479:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776384.100677:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884788 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.100701:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884788 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.100713:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884788 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.100723:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257600, rc 0) 00000100:00100000:3.0:1789776384.101009:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449453696:12345-0@lo:101: Request processed in 309us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.101017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789776384.106115:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453696:0@lo:101: 00010000:00010000:0.0:1789776384.106148:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.106469:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776384.106581:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453824:0@lo:501: 00000100:00100000:0.0:1789776384.106645:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.106687:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.106765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453824 00000100:00100000:3.0:1789776384.106852:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453824 00000100:00100000:3.0:1789776384.106912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776384.106923:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449453824:12345-0@lo:501: 00000100:00100000:3.0:1789776384.107362:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449453824:12345-0@lo:501: Request processed in 441us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.107371:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789776384.107474:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453824:0@lo:501: 00000100:00100000:1.0:1789776384.107535:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453952:0@lo:503: 00000100:00100000:1.0:1789776384.107577:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.107607:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74fa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.107685:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449453952 00000100:00100000:3.0:1789776384.107690:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449453952 00000100:00100000:3.0:1789776384.107751:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789776384.107759:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449453952:12345-0@lo:503: 00000100:00100000:3.0:1789776384.107853:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449453952:12345-0@lo:503: Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.107864:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789776384.107988:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449453952:0@lo:503: 00000100:00100000:2.0:1789776384.108430:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8511:1876716449454080:0@lo:502: 00000100:00100000:2.0:1789776384.108472:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.108487:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776384.108624:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454080 00000100:00100000:0.0:1789776384.108629:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454080 00000100:00100000:0.0:1789776384.108664:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789776384.108673:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8511:x1876716449454080:12345-0@lo:502: 00000100:00100000:0.0:1789776384.108759:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8511:x1876716449454080:12345-0@lo:502: Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.108766:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789776384.109304:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8511:1876716449454080:0@lo:502: 00000100:00100000:2.0:1789776384.109358:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8511:1876716449454208:0@lo:502: 00000100:00100000:2.0:1789776384.109394:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.109426:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776384.109469:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454208 00000100:00100000:0.0:1789776384.109473:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454208 00000100:00100000:0.0:1789776384.109670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789776384.109679:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8511:x1876716449454208:12345-0@lo:502: 00000100:00100000:0.0:1789776384.109757:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:8511:x1876716449454208:12345-0@lo:502: Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.109765:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776384.109862:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8511:1876716449454208:0@lo:502: 00000040:00080000:2.0:1789776384.109880:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789776384.110081:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789776384.110103:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776384.110112:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.110123:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776384.110133:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789776384.110135:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cd0f5c800 from 5 10000000:01000000:0.0:1789776384.110138:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776384.110235:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.110250:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.110260:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776384.110274:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454336:0@lo:101: 00000100:00100000:0.0:1789776384.110304:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.110334:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.110379:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454336 00000100:00100000:2.0:1789776384.110383:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454336 00000100:00100000:2.0:1789776384.110422:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789776384.110430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449454336:12345-0@lo:101: 00010000:00010000:2.0:1789776384.110438:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776384.110453:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884796 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.110473:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884796 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.110484:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884796 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.110513:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217e200, rc 0) 00000100:00100000:2.0:1789776384.110548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449454336:12345-0@lo:101: Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.110555:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789776384.110639:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454336:0@lo:101: 00010000:00010000:0.0:1789776384.110654:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.110663:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776384.110710:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454464:0@lo:256: 00000100:00100000:0.0:1789776384.110742:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.110763:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.111008:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454464 00000100:00100000:1.0:1789776384.111015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454464 00000100:00100000:1.0:1789776384.111049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789776384.111057:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449454464:12345-0@lo:256: 20000000:01000000:1.0:1789776384.111072:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776384.111088:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776384.111091:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789776384.111172:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449454464:12345-0@lo:256: Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.111178:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789776384.111266:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454464:0@lo:256: 10000000:01000000:0.0:1789776384.111308:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789776384.111314:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.111323:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776384.111340:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789776384.111341:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789776384.111344:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789776384.111361:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.111369:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.111377:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776384.111388:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454592:0@lo:101: 00000100:00100000:0.0:1789776384.111413:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.111439:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.111531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454592 00000100:00100000:1.0:1789776384.111535:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454592 00000100:00100000:1.0:1789776384.111563:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789776384.111570:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449454592:12345-0@lo:101: 00010000:00010000:1.0:1789776384.111580:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776384.111592:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8847a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.111912:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.111926:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.111933:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776384.111976:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449454592:12345-0@lo:101: Request processed in 407us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.111981:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789776384.112032:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454592:0@lo:101: 00010000:00010000:3.0:1789776384.112046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.112055:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.112104:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454720:0@lo:501: 00000100:00100000:3.0:1789776384.112129:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.112155:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.112280:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454720 00000100:00100000:1.0:1789776384.112286:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454720 00000100:00100000:1.0:1789776384.112319:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789776384.112326:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449454720:12345-0@lo:501: 00000100:00100000:1.0:1789776384.112468:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449454720:12345-0@lo:501: Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.112475:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789776384.112552:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454720:0@lo:501: 00000100:00100000:3.0:1789776384.112580:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454848:0@lo:503: 00000100:00100000:3.0:1789776384.112613:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.112636:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.113155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454848 00000100:00100000:1.0:1789776384.113166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454848 00000100:00100000:1.0:1789776384.113212:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789776384.113219:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449454848:12345-0@lo:503: 00000100:00100000:1.0:1789776384.113999:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449454848:12345-0@lo:503: Request processed in 776us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.114007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789776384.114062:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449454848:0@lo:503: 00000100:00100000:1.0:1789776384.116624:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8513:1876716449454976:0@lo:502: 00000100:00100000:1.0:1789776384.116686:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.116723:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776384.116788:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449454976 00000100:00100000:0.0:1789776384.116794:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449454976 00000100:00100000:0.0:1789776384.116836:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789776384.116845:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:8513:x1876716449454976:12345-0@lo:502: 00000100:00100000:0.0:1789776384.117096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:8513:x1876716449454976:12345-0@lo:502: Request processed in 251us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.117103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776384.117181:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8513:1876716449454976:0@lo:502: 00000020:01000000:1.0:1789776384.117209:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789776384.117218:0:8513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789776384.117225:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776384.117227:0:8513:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789776384.117233:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789776384.117237:0:8513:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1789776384.117258:0:8513:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789776384.117260:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776384.117275:0:8513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a5cfaf28000) 00000020:00000080:1.0:1789776384.117296:0:8513:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789776384.117315:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789776384.117396:0:8513:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789776384.117403:0:8513:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789776384.117419:0:8513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb8847b9 00010000:00080000:1.0:1789776384.117445:0:8513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cd93f0800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1789776384.117687:0:8513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789776384.136359:0:8513:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789776384.136381:0:8513:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789776384.136619:0:8513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776384.136868:0:8513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776384.136953:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789776384.137036:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789776384.137654:0:8515:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776384.137659:0:8515:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789776384.138411:0:8513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789776384.138425:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789776384.138463:0:8513:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789776384.138484:0:8513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb8847c0 00000100:00080000:3.0:1789776384.138521:0:8513:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776384.138527:0:8513:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a5cd93f0800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776384.138559:0:8513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cedcef480 x1876716449455104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776384.138579:0:8513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789776384.138643:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449455104:0@lo:8: 00000100:00100000:2.0:1789776384.138708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789776384.139177:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776384.139182:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.139184:0:8513:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789776384.139188:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776384.139192:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.139194:0:8513:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776384.139197:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776384.139198:0:8513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789776384.139223:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8513:1876716449455232:0@lo:502: 00000100:00100000:3.0:1789776384.139271:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.139295:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.139318:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455104 00000100:00100000:3.0:1789776384.139324:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455104 00000100:00100000:3.0:1789776384.139356:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776384.139363:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449455104:12345-0@lo:8: 00010000:00080000:3.0:1789776384.139387:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1789776384.139410:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb8847c7 00002000:00100000:3.0:1789776384.139442:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a5cd0fc4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789776384.139447:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789776384.139451:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789776384.139549:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789776384.139846:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789776384.139869:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5cec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776384.139925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449455104:12345-0@lo:8: Request processed in 560us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.139933:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776384.139957:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455232 00000100:00100000:3.0:1789776384.139961:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455232 00000100:00100000:3.0:1789776384.139989:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789776384.140003:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:8513:x1876716449455232:12345-0@lo:502: 00000100:00100000:3.0:1789776384.140100:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:8513:x1876716449455232:12345-0@lo:502: Request processed in 97us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.140107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789776384.140162:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8513:1876716449455232:0@lo:502: 00000020:01000000:3.0:1789776384.140193:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776384.140197:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.140199:0:8513:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789776384.140203:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789776384.140311:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789776384.140330:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789776384.140338:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140348:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776384.140358:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776384.140361:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cdb443800 from 30 10000000:01000000:3.0:1789776384.140364:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776384.140390:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140398:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140406:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.140421:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455360:0@lo:101: 00000100:00100000:3.0:1789776384.140456:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.140475:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.140488:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455360 00000100:00100000:3.0:1789776384.140515:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455360 00000100:00100000:3.0:1789776384.140538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789776384.140543:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449455360:12345-0@lo:101: 00010000:00010000:3.0:1789776384.140551:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776384.140561:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8847ce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140581:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140591:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140600:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257c00, rc 0) 00000100:00100000:3.0:1789776384.140629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449455360:12345-0@lo:101: Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.140634:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789776384.140662:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455360:0@lo:101: 00010000:00010000:3.0:1789776384.140674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.140682:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.140726:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455488:0@lo:501: 00000100:00100000:3.0:1789776384.140762:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.140788:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.140800:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455488 00000100:00100000:3.0:1789776384.140803:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455488 00000100:00100000:3.0:1789776384.140825:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776384.140832:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449455488:12345-0@lo:501: 00000100:00100000:3.0:1789776384.140926:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449455488:12345-0@lo:501: Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.140932:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776384.140956:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455488:0@lo:501: 00000100:00100000:3.0:1789776384.140979:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455616:0@lo:503: 00000100:00100000:3.0:1789776384.141009:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.141020:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.141029:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455616 00000100:00100000:3.0:1789776384.141031:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455616 00000100:00100000:3.0:1789776384.141048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789776384.141054:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449455616:12345-0@lo:503: 00000100:00100000:3.0:1789776384.141113:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449455616:12345-0@lo:503: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.141119:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789776384.141153:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449455616:0@lo:503: 00000100:00100000:3.0:1789776384.141328:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8518:1876716449455744:0@lo:502: 00000100:00100000:3.0:1789776384.141359:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.141376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455744 00000100:00100000:3.0:1789776384.141379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455744 00000100:00100000:3.0:1789776384.141396:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789776384.141408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:8518:x1876716449455744:12345-0@lo:502: 00000100:00100000:3.0:1789776384.141473:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:8518:x1876716449455744:12345-0@lo:502: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.141479:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789776384.141529:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.141543:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8518:1876716449455744:0@lo:502: 00000100:00100000:3.0:1789776384.141581:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8518:1876716449455872:0@lo:502: 00000100:00100000:3.0:1789776384.141613:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.141633:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449455872 00000100:00100000:3.0:1789776384.141636:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449455872 00000100:00100000:3.0:1789776384.141656:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789776384.141663:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:8518:x1876716449455872:12345-0@lo:502: 00000100:00100000:3.0:1789776384.141718:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:8518:x1876716449455872:12345-0@lo:502: Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.141724:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789776384.141751:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.141763:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8518:1876716449455872:0@lo:502: 00000040:00080000:3.0:1789776384.141796:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789776384.141835:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789776384.141850:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776384.141859:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.141868:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776384.141875:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789776384.141884:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cdb443800 from 5 10000000:01000000:3.0:1789776384.141886:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789776384.141906:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.141914:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.141922:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.141933:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449456000:0@lo:101: 00000100:00100000:2.0:1789776384.145705:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449456256:0@lo:400: 00000100:00100000:2.0:1789776384.145786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.145828:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449456768:0@lo:400: 00000100:00100000:2.0:1789776384.145855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.145877:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789776384.145884:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449456128:0@lo:400: 00000100:00100000:2.0:1789776384.145907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.145923:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449456640:0@lo:400: 00000100:00100000:2.0:1789776384.145947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.145976:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456256 00000100:00100000:2.0:1789776384.145983:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456256 00000100:00100000:2.0:1789776384.146022:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776384.146031:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449456256:12345-0@lo:400: 00000100:00100000:2.0:1789776384.146079:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449456256:12345-0@lo:400: Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.146086:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776384.146109:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456768 00000100:00100000:2.0:1789776384.146113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456768 00000100:00100000:2.0:1789776384.146143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456128 00000100:00100000:2.0:1789776384.146147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456128 00000100:00100000:2.0:1789776384.146281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456640 00000100:00100000:2.0:1789776384.146284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456640 00000100:00100000:2.0:1789776384.146300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776384.146307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449456768:12345-0@lo:400: 00000100:00100000:2.0:1789776384.146339:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449456768:12345-0@lo:400: Request processed in 33us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.146345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776384.146356:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776384.146361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449456128:12345-0@lo:400: 00000100:00100000:2.0:1789776384.146387:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449456128:12345-0@lo:400: Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.146400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776384.146413:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776384.146420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449456640:12345-0@lo:400: 00000100:00100000:2.0:1789776384.146448:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449456640:12345-0@lo:400: Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.146453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776384.146553:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449456384:0@lo:400: 00000100:00100000:1.0:1789776384.146585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.146608:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776384.146614:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449456512:0@lo:400: 00000100:00100000:1.0:1789776384.146637:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789776384.146745:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc397b80 x1876716449456128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.146760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449456128:0@lo:400: 00010000:00080000:2.0:1789776384.146785:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394000 x1876716449456640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.146794:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449456640:0@lo:400: 00000100:00100000:2.0:1789776384.146804:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449456256:0@lo:400: 00010000:00080000:2.0:1789776384.146814:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394a80 x1876716449456768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.146821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449456768:0@lo:400: 00000100:00080000:2.0:1789776384.146849:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776384.146853:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776384.146862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456384 00000100:00100000:2.0:1789776384.146866:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456384 00000100:00100000:2.0:1789776384.146887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776384.146893:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449456384:12345-0@lo:400: 00000100:00100000:2.0:1789776384.146941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449456384:12345-0@lo:400: Request processed in 48us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.146957:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789776384.146987:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394700 x1876716449456384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.146996:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449456384:0@lo:400: 00010000:00080000:2.0:1789776384.147024:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef480 x1876716449455104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.147033:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776384.147042:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789776384.147052:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776384.147057:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789776384.147061:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776384.147078:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776384.147084:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449455104:0@lo:8: 00000100:00100000:2.0:1789776384.147123:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449456896:0@lo:700: 00000100:00100000:2.0:1789776384.147147:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.147283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456512 00000100:00100000:0.0:1789776384.147287:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456512 00000100:00100000:0.0:1789776384.147315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776384.147322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449456512:12345-0@lo:400: 00000100:00100000:0.0:1789776384.147435:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449456512:12345-0@lo:400: Request processed in 114us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.147448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776384.147479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449456512:0@lo:400: 00000100:00100000:1.0:1789776384.149141:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456896 00000100:00100000:1.0:1789776384.149150:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456896 00000100:00100000:1.0:1789776384.149206:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776384.149214:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8516:x1876716449456896:12345-0@lo:700: 00000100:00100000:1.0:1789776384.149260:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1876716449457024:0@lo:700: 00000100:00100000:1.0:1789776384.149311:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.149336:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457024 00000100:00100000:1.0:1789776384.149340:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776384.149340:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457024 00000004:00080000:1.0:1789776384.149359:0:8515:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789776384.149364:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776384.149370:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1876716449457024:12345-0@lo:700: 00000004:00080000:1.0:1789776384.149424:0:8515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 205393929942ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789776384.149430:0:8515:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1789776384.150140:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776384.150160:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.150307:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.150335:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.150444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449456000 00000100:00100000:2.0:1789776384.150449:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449456000 00000100:00100000:2.0:1789776384.150484:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776384.150513:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449456000:12345-0@lo:101: 00010000:00010000:2.0:1789776384.150524:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776384.150541:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8847dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.150666:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.150685:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.150694:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ee00, rc 0) 00000100:00100000:2.0:1789776384.151011:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449456000:12345-0@lo:101: Request processed in 518us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.151018:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789776384.151107:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449456000:0@lo:101: 00010000:00010000:3.0:1789776384.151125:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.151136:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.151196:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457152:0@lo:256: 00000100:00100000:3.0:1789776384.151232:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.151336:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.151367:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457152 00000100:00100000:2.0:1789776384.151372:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457152 00000100:00100000:2.0:1789776384.151432:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776384.151439:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449457152:12345-0@lo:256: 20000000:01000000:2.0:1789776384.151452:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776384.151467:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776384.151469:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789776384.151637:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449457152:12345-0@lo:256: Request processed in 198us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.151644:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789776384.151742:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457152:0@lo:256: 10000000:01000000:1.0:1789776384.151808:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776384.151815:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.151825:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776384.151843:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789776384.151845:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789776384.151848:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789776384.151868:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.151876:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.151884:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.151895:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457280:0@lo:101: 00000100:00100000:1.0:1789776384.151921:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.152279:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.152338:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457280 00000100:00100000:3.0:1789776384.152344:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457280 00000100:00100000:3.0:1789776384.152368:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789776384.152375:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449457280:12345-0@lo:101: 00010000:00010000:3.0:1789776384.152384:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776384.152399:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8847ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.152416:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.152425:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.152433:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257200, rc 0) 00000100:00100000:3.0:1789776384.152473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449457280:12345-0@lo:101: Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.152479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789776384.152582:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457280:0@lo:101: 00010000:00010000:1.0:1789776384.152593:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.152601:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.152655:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457408:0@lo:501: 00000100:00100000:1.0:1789776384.152679:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.152715:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.152894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457408 00000100:00100000:3.0:1789776384.152898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457408 00000100:00100000:3.0:1789776384.152915:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789776384.152921:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449457408:12345-0@lo:501: 00000100:00100000:3.0:1789776384.153031:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449457408:12345-0@lo:501: Request processed in 109us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.153037:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776384.153098:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457408:0@lo:501: 00000100:00100000:1.0:1789776384.153120:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457536:0@lo:503: 00000100:00100000:1.0:1789776384.153155:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.153174:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.153218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457536 00000100:00100000:3.0:1789776384.153222:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457536 00000100:00100000:3.0:1789776384.153239:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789776384.153244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449457536:12345-0@lo:503: 00000100:00100000:3.0:1789776384.153322:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449457536:12345-0@lo:503: Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.153329:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789776384.153398:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449457536:0@lo:503: 00000100:00100000:1.0:1789776384.153710:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8520:1876716449457664:0@lo:502: 00000100:00100000:1.0:1789776384.153746:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.153787:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9194540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.153866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457664 00000100:00100000:2.0:1789776384.153874:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457664 00000100:00100000:2.0:1789776384.153911:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789776384.153918:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:8520:x1876716449457664:12345-0@lo:502: 00000100:00100000:2.0:1789776384.154010:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:8520:x1876716449457664:12345-0@lo:502: Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.154016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789776384.154097:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8520:1876716449457664:0@lo:502: 00000020:01000000:3.0:1789776384.154131:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789776384.154138:0:8520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789776384.154144:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.154146:0:8520:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789776384.154151:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789776384.154236:0:8520:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1789776384.154259:0:8520:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789776384.154262:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776384.154283:0:8520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a5cff3b4d28) 00000020:00000080:3.0:1789776384.154303:0:8520:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789776384.154310:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789776384.154380:0:8520:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789776384.154386:0:8520:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789776384.154392:0:8520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb8847ff 00010000:00080000:3.0:1789776384.154420:0:8520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cf5ce8000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1789776384.154676:0:8520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:2.0:1789776384.169634:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:0.0:1789776384.173686:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789776384.189720:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1876716449457024:12345-0@lo:700: Request processed in 40340us (40399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.189737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789776384.189822:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf0f73b80 x1876716449457024/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776384.189840:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1876716449457024:0@lo:700: 40000000:02000000:0.0:1789776384.189856:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1789776384.193487:0:8520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789776384.193539:0:8520:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789776384.193760:0:8520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776384.194166:0:8520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776384.194254:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789776384.194342:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789776384.197340:0:8523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776384.197347:0:8523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789776384.198134:0:8520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776384.198148:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789776384.198196:0:8520:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789776384.198225:0:8520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb884806 00000100:00080000:2.0:1789776384.198238:0:8520:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776384.198245:0:8520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a5cf5ce8000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776384.198295:0:8520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cfc395880 x1876716449457792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776384.198320:0:8520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789776384.198404:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776384.198407:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776384.198409:0:8520:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789776384.198412:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776384.198416:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776384.198417:0:8520:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789776384.198419:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789776384.198421:0:8520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789776384.198453:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8520:1876716449457920:0@lo:502: 00000100:00100000:2.0:1789776384.198565:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.198605:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4e74300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.198623:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449457792:0@lo:8: 00000100:00100000:2.0:1789776384.198652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.198700:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457920 00000100:00100000:2.0:1789776384.198706:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457920 00000100:00100000:2.0:1789776384.198748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789776384.198757:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:8520:x1876716449457920:12345-0@lo:502: 00000100:00100000:2.0:1789776384.198877:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:8520:x1876716449457920:12345-0@lo:502: Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.198885:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789776384.198921:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449457792 00000100:00100000:2.0:1789776384.198924:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449457792 00000100:00100000:2.0:1789776384.198956:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776384.198960:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449457792:12345-0@lo:8: 00010000:00080000:2.0:1789776384.198979:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1789776384.198999:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb88480d 00002000:00100000:2.0:1789776384.199011:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a5cfc249800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789776384.199014:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789776384.199017:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789776384.199079:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789776384.199099:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc24b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776384.199132:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449457792:12345-0@lo:8: Request processed in 171us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.199138:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789776384.199168:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc395880 x1876716449457792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.199179:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776384.199187:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789776384.199193:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776384.199198:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789776384.199200:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776384.199207:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776384.199212:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449457792:0@lo:8: 00000100:00100000:2.0:1789776384.199243:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:8520:1876716449457920:0@lo:502: 00000020:01000000:2.0:1789776384.199265:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776384.199270:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776384.199272:0:8520:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789776384.199276:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789776384.199395:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789776384.199422:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789776384.199432:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.199442:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.199452:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789776384.199454:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5cc8c63370 from 1 10000000:01000000:2.0:1789776384.199458:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789776384.199484:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.199513:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.199523:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.199538:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449458048:0@lo:101: 00000100:00100000:2.0:1789776384.199567:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.199593:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6e40 going to sleep for 11 seconds 00000004:00080000:1.0:1789776384.199786:0:8523:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789776384.199833:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 205444339015ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789776384.199838:0:8523:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789776384.202270:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458048 00000100:00100000:1.0:1789776384.202286:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458048 00000100:00100000:1.0:1789776384.202340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789776384.202351:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449458048:12345-0@lo:101: 00010000:00010000:1.0:1789776384.202367:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776384.202386:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884814 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.202415:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884814 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.202428:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884814 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.202449:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1c00, rc 0) 00000100:00100000:1.0:1789776384.202545:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449458048:12345-0@lo:101: Request processed in 195us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.202554:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789776384.202699:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449458048:0@lo:101: 00010000:00010000:2.0:1789776384.202718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.202728:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.202813:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449458176:0@lo:501: 00000100:00100000:2.0:1789776384.202870:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.202901:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.202916:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458176 00000100:00100000:2.0:1789776384.202919:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458176 00000100:00100000:2.0:1789776384.202962:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789776384.202971:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449458176:12345-0@lo:501: 00000100:00100000:2.0:1789776384.203046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449458176:12345-0@lo:501: Request processed in 76us (175us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776384.203052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789776384.203079:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449458176:0@lo:501: 10000000:01000000:2.0:1789776384.203104:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789776384.203110:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.203118:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789776384.205524:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789776384.205535:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789776384.205990:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449456896:12345-0@lo:700: Request processed in 56773us (58837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.206007:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789776384.206222:0:8516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394700 x1876716449456896/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776384.206237:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449456896:0@lo:700: 00000004:00080000:3.0:1789776384.218954:0:8516:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789776384.218969:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449458304:0@lo:13: 00000100:00100000:3.0:1789776384.218986:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458432:0@lo:7: 00000004:00080000:3.0:1789776384.219883:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789776384.219947:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.219997:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458432 00000100:00100000:3.0:1789776384.220004:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458432 00000100:00100000:3.0:1789776384.220053:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776384.220063:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449458432:12345-0@lo:7: 00000100:00100000:0.0:1789776384.220600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.222473:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449458560:0@lo:13: 00000100:00100000:2.0:1789776384.222563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.223435:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458304 00000100:00100000:2.0:1789776384.223444:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458304 00000100:00100000:2.0:1789776384.223480:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458560 00000100:00100000:2.0:1789776384.223483:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458560 00000100:00100000:2.0:1789776384.223529:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776384.223537:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876716449458304:12345-0@lo:13: 00002000:00000024:2.0:1789776384.223559:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1789776384.224673:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876716449458304:12345-0@lo:13: Request processed in 1132us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.224688:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776384.224713:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776384.224722:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449458560:12345-0@lo:13: 00002000:00000024:2.0:1789776384.224741:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1789776384.224798:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449458560:12345-0@lo:13: Request processed in 78us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.224805:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789776384.224827:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776384.224873:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394000 x1876716449458560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.224893:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449458560:0@lo:13: 00010000:00080000:2.0:1789776384.224933:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcec380 x1876716449458304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.224945:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449458304:0@lo:13: 00000004:00080000:2.0:1789776384.224965:0:8524:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789776384.225166:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449458688:0@lo:7: 00000100:00100000:2.0:1789776384.225207:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.225239:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789776384.225246:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789776384.225370:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.225635:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789776384.225645:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458688 00000100:00100000:2.0:1789776384.225651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458688 00000100:00100000:2.0:1789776384.225691:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cea8c4000 going to sleep for 11 seconds 00002000:00080000:3.0:1789776384.232237:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789776384.232252:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789776384.232412:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449458432:12345-0@lo:7: Request processed in 12344us (12459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.232424:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776384.232464:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776384.232479:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8524:x1876716449458688:12345-0@lo:7: 00002000:00080000:3.0:1789776384.243845:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789776384.243856:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789776384.244229:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8524:x1876716449458688:12345-0@lo:7: Request processed in 11751us (19017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.244241:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789776384.244301:0:8516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef100 x1876716449458432/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776384.244384:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458432:0@lo:7: 00000004:00080000:3.0:1789776384.244400:0:8516:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789776384.244442:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458816:0@lo:5: 00000100:00100000:3.0:1789776384.244483:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.244939:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cea8c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.246154:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458816 00000100:00100000:3.0:1789776384.246164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458816 00000100:00100000:3.0:1789776384.246371:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776384.246383:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449458816:12345-0@lo:5: 00002000:00080000:3.0:1789776384.246416:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789776384.246482:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449458816:12345-0@lo:5: Request processed in 103us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.246489:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789776384.246821:0:8516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef100 x1876716449458816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776384.246848:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458816:0@lo:5: 00000004:00080000:3.0:1789776384.246863:0:8516:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789776384.246908:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458944:0@lo:5: 00000100:00100000:3.0:1789776384.246946:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.246970:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cea8c4000 going to sleep for 11 seconds 00010000:00080000:1.0:1789776384.250834:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394000 x1876716449458688/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776384.250853:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449458688:0@lo:7: 00000004:00080000:1.0:1789776384.250869:0:8524:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789776384.250912:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459072:0@lo:5: 00000100:00100000:1.0:1789776384.252080:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.252125:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc537f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.252179:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449458944 00000100:00100000:1.0:1789776384.252186:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449458944 00000100:00100000:1.0:1789776384.252234:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459072 00000100:00100000:1.0:1789776384.252237:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459072 00000100:00100000:1.0:1789776384.252251:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776384.252259:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8516:x1876716449458944:12345-0@lo:5: 00002000:00080000:1.0:1789776384.252301:0:8528:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789776384.253128:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776384.253142:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8524:x1876716449459072:12345-0@lo:5: 00002000:00080000:2.0:1789776384.253170:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789776384.253173:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789776384.253586:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8524:x1876716449459072:12345-0@lo:5: Request processed in 448us (1511us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789776384.253594:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789776384.257449:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf0f73b80 x1876716449459072/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.257471:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459072:0@lo:5: 00000004:00080000:2.0:1789776384.257486:0:8524:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789776384.257609:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459200:0@lo:700: 00000100:00100000:1.0:1789776384.260833:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8516:x1876716449458944:12345-0@lo:5: Request processed in 8563us (13875us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789776384.260848:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776384.263067:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.263142:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459200 00000100:00100000:2.0:1789776384.263150:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459200 00000100:00100000:2.0:1789776384.263200:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776384.263211:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8524:x1876716449459200:12345-0@lo:700: 00000100:00100000:2.0:1789776384.274420:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6240 going to sleep for 11 seconds 00010000:00080000:3.0:1789776384.275195:0:8516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef100 x1876716449458944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776384.275213:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8516:1876716449458944:0@lo:5: 00000004:00080000:3.0:1789776384.275227:0:8516:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789776384.275269:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8516:1876716449459328:0@lo:900: 00000100:00100000:3.0:1789776384.275326:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.275374:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459328 00000100:00100000:3.0:1789776384.275380:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459328 00000100:00100000:3.0:1789776384.275430:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776384.275440:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8516:x1876716449459328:12345-0@lo:900: 00000100:00100000:3.0:1789776384.275520:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8516:x1876716449459328:12345-0@lo:900: Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.275528:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776384.275550:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d13480 going to sleep for 11 seconds 00010000:00080000:3.0:1789776384.275566:0:8516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc81f7b80 x1876716449459328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776384.275576:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8516:1876716449459328:0@lo:900: 00000001:00080000:2.0:1789776384.278591:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789776384.278606:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1789776384.278880:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8524:x1876716449459200:12345-0@lo:700: Request processed in 15666us (15814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.278891:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789776384.279008:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc394e00 x1876716449459200/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.279019:0:8524:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789776384.279038:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459200:0@lo:700: 00000004:02000040:1.0:1789776384.280962:0:8524:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789776384.285352:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459456:0@lo:5: 00000100:00100000:1.0:1789776384.285439:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.285575:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc537f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.288561:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459456 00000100:00100000:2.0:1789776384.288590:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459456 00000100:00100000:1.0:1789776384.294185:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776384.294199:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8524:x1876716449459456:12345-0@lo:5: 00002000:00080000:1.0:1789776384.308472:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789776384.308515:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789776384.313148:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8524:x1876716449459456:12345-0@lo:5: Request processed in 18946us (27701us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789776384.313161:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789776384.313230:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf0f73b80 x1876716449459456/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776384.313249:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8524:1876716449459456:0@lo:5: 00000004:00080000:1.0:1789776384.313264:0:8524:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1789776384.418738:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776385.442806:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776386.468249:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776387.496741:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776388.130799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449459584:0@lo:41: 00000100:00100000:2.0:1789776388.130868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776388.130998:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459584 00000100:00100000:0.0:1789776388.131006:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459584 00000100:00100000:0.0:1789776388.131056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776388.131066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449459584:12345-0@lo:41: 00000004:00000024:0.0:1789776388.131108:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789776388.131156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449459584:12345-0@lo:41: Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776388.131163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776388.131256:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449459584:0@lo:41: 00000100:00100000:0.0:1789776388.131530:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776388.131540:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449459712:0@lo:41: 00000100:00100000:0.0:1789776388.131566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776388.131661:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459712 00000100:00100000:2.0:1789776388.131665:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459712 00000100:00100000:2.0:1789776388.131708:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776388.131715:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449459712:12345-0@lo:41: 00000004:00000024:2.0:1789776388.131733:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789776388.131776:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449459712:12345-0@lo:41: Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776388.131782:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789776388.131851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449459712:0@lo:41: 00010000:00010000:2.0:1789776388.517627:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776388.614483:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1789776389.516140:0:8860:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776389.516393:0:8860:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789776389.538871:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776389.666799:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449459840:0@lo:13: 00000100:00100000:2.0:1789776389.666880:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776389.666958:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459840 00000100:00100000:2.0:1789776389.666965:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459840 00000100:00100000:2.0:1789776389.667016:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776389.667026:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449459840:12345-0@lo:13: 00002000:00000024:2.0:1789776389.667058:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776389.667101:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449459840:12345-0@lo:13: Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776389.667108:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789776389.667128:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776389.667171:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc397480 x1876716449459840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776389.667181:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789776389.667204:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449459840:0@lo:13: 00000100:00100000:0.0:1789776389.667460:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449460096:0@lo:400: 00000100:00100000:0.0:1789776389.667489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.667530:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449460608:0@lo:400: 00000100:00100000:0.0:1789776389.667548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.667562:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776389.667567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449460224:0@lo:400: 00000100:00100000:0.0:1789776389.667609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.667626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449460736:0@lo:400: 00000100:00100000:0.0:1789776389.667647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.667682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460096 00000100:00100000:0.0:1789776389.667686:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460096 00000100:00100000:0.0:1789776389.667710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460608 00000100:00100000:0.0:1789776389.667713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460608 00000100:00100000:0.0:1789776389.667732:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460736 00000100:00100000:0.0:1789776389.667735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460736 00000100:00100000:0.0:1789776389.667750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776389.667757:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449460096:12345-0@lo:400: 00000100:00100000:0.0:1789776389.667795:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449460096:12345-0@lo:400: Request processed in 38us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.667801:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776389.667821:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776389.667827:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449460608:12345-0@lo:400: 00000100:00100000:0.0:1789776389.667864:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449460608:12345-0@lo:400: Request processed in 38us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.667870:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776389.667880:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776389.667884:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449460736:12345-0@lo:400: 00000100:00100000:0.0:1789776389.667903:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449460736:12345-0@lo:400: Request processed in 19us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.667908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776389.667927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460224 00000100:00100000:0.0:1789776389.667930:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460224 00000100:00100000:0.0:1789776389.667952:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789776389.667957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449460224:12345-0@lo:400: 00000100:00100000:0.0:1789776389.667983:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449460224:12345-0@lo:400: Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.667988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789776389.668005:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776389.668008:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776389.668025:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449460224:0@lo:400: 00010000:00080000:0.0:1789776389.668034:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc815ea00 x1876716449460736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776389.668042:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449460736:0@lo:400: 00010000:00080000:0.0:1789776389.668051:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc815df80 x1876716449460096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776389.668059:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449460096:0@lo:400: 00010000:00080000:0.0:1789776389.668075:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc815e300 x1876716449460608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776389.668082:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449460608:0@lo:400: 00000100:00100000:0.0:1789776389.668102:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449460352:0@lo:400: 00000100:00100000:0.0:1789776389.668123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.668137:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449460864:0@lo:400: 00000100:00100000:0.0:1789776389.668157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.668169:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789776389.668174:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449459968:0@lo:400: 00000100:00100000:0.0:1789776389.668194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.668211:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449460480:0@lo:400: 00000100:00100000:0.0:1789776389.668225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776389.668242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460480 00000100:00100000:0.0:1789776389.668245:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460480 00000100:00100000:0.0:1789776389.668262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776389.668266:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449460480:12345-0@lo:400: 00000100:00100000:0.0:1789776389.668293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449460480:12345-0@lo:400: Request processed in 26us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.668298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776389.668311:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460352 00000100:00100000:0.0:1789776389.668313:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460352 00000100:00100000:0.0:1789776389.668327:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776389.668332:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449460352:12345-0@lo:400: 00000100:00100000:0.0:1789776389.668352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449460352:12345-0@lo:400: Request processed in 20us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776389.668365:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776389.668387:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449460480:0@lo:400: 00010000:00080000:0.0:1789776389.668395:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc815c380 x1876716449460352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776389.668402:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449460352:0@lo:400: 00000100:00100000:2.0:1789776389.668747:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449459968 00000100:00100000:2.0:1789776389.668752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449459968 00000100:00100000:2.0:1789776389.668782:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789776389.668788:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449459968:12345-0@lo:400: 00000100:00100000:2.0:1789776389.668822:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449459968:12345-0@lo:400: Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776389.669576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789776389.671737:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449459968:0@lo:400: 00000100:00100000:1.0:1789776389.671928:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460864 00000100:00100000:1.0:1789776389.671935:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460864 00000100:00100000:1.0:1789776389.671990:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776389.671999:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449460864:12345-0@lo:400: 00000100:00100000:1.0:1789776389.672070:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449460864:12345-0@lo:400: Request processed in 72us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776389.672077:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776389.672115:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449460992:0@lo:13: 00000100:00100000:1.0:1789776389.672147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789776389.672177:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776389.672208:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449460992 00000100:00100000:1.0:1789776389.672213:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449460992 00000100:00100000:1.0:1789776389.672235:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776389.672241:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449460992:12345-0@lo:13: 00002000:00000024:1.0:1789776389.672260:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776389.672293:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449460992:12345-0@lo:13: Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776389.672300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789776389.672329:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff349f80 x1876716449460992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776389.672361:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449460992:0@lo:13: 00010000:00080000:1.0:1789776389.672384:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc815ed80 x1876716449460864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776389.672392:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449460864:0@lo:400: 00000001:00080000:0.0:1789776389.682916:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1789776390.565677:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776391.590874:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789776392.106169:0:8961:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776392.106380:0:8961:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776392.611800:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776392.897198:0:9009:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776392.897208:0:9009:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789776393.251433:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449461120:0@lo:41: 00000100:00100000:1.0:1789776393.251557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776393.251891:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461120 00000100:00100000:3.0:1789776393.251900:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461120 00000100:00100000:3.0:1789776393.251958:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776393.251968:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449461120:12345-0@lo:41: 00000004:00000024:3.0:1789776393.252006:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789776393.252228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449461248:0@lo:41: 00000100:00100000:0.0:1789776393.252259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776393.255209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461248 00000100:00100000:2.0:1789776393.255228:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461248 00000100:00100000:2.0:1789776393.255316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789776393.255328:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449461248:12345-0@lo:41: 00000004:00000024:2.0:1789776393.255375:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789776393.255458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449461248:12345-0@lo:41: Request processed in 132us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776393.255465:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776393.256392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449461248:0@lo:41: 00000100:00100000:3.0:1789776393.256699:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449461120:12345-0@lo:41: Request processed in 4731us (5141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776393.256710:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776393.256866:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449461120:0@lo:41: 00010000:00010000:2.0:1789776393.634723:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776394.662842:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776394.786826:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449461376:0@lo:13: 00000100:00100000:2.0:1789776394.786925:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449461760:0@lo:400: 00000100:00100000:0.0:1789776394.786953:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449461888:0@lo:400: 00000100:00100000:3.0:1789776394.787121:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449461632:0@lo:400: 00000100:00100000:0.0:1789776394.788794:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776394.789037:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449462400:0@lo:400: 00000100:00100000:0.0:1789776394.789078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776394.789129:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461888 00000100:00100000:0.0:1789776394.789139:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461888 00000100:00100000:0.0:1789776394.789185:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789776394.789195:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449461888:12345-0@lo:400: 00000100:00100000:0.0:1789776394.789254:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449461888:12345-0@lo:400: Request processed in 60us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.789260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789776394.789282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462400 00000100:00100000:0.0:1789776394.789296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462400 00000100:00100000:0.0:1789776394.789333:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789776394.789339:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449462400:12345-0@lo:400: 00000100:00100000:0.0:1789776394.789370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449462400:12345-0@lo:400: Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.789376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789776394.789395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776394.789425:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449461888:0@lo:400: 00010000:00080000:0.0:1789776394.789439:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0ad80 x1876716449462400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776394.789449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449462400:0@lo:400: 00000100:00100000:1.0:1789776394.789654:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776394.789685:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449461504:0@lo:13: 00000100:00100000:1.0:1789776394.789717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776394.789745:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449462016:0@lo:400: 00000100:00100000:1.0:1789776394.789765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776394.789779:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449462528:0@lo:400: 00000100:00100000:1.0:1789776394.789799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776394.789829:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461376 00000100:00100000:1.0:1789776394.789840:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461376 00000100:00100000:1.0:1789776394.789886:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461504 00000100:00100000:1.0:1789776394.789889:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461504 00000100:00100000:1.0:1789776394.789905:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776394.789910:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449461376:12345-0@lo:13: 00002000:00000024:1.0:1789776394.789936:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776394.790188:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449461376:12345-0@lo:13: Request processed in 276us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776394.790195:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776394.790222:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776394.790229:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449461504:12345-0@lo:13: 00002000:00000024:1.0:1789776394.790240:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776394.790266:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449461504:12345-0@lo:13: Request processed in 38us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776394.790272:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789776394.790307:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff349500 x1876716449461376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776394.790315:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789776394.790333:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449461376:0@lo:13: 00010000:00080000:1.0:1789776394.790344:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc395500 x1876716449461504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776394.790357:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449461504:0@lo:13: 00000100:00100000:0.0:1789776394.790545:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462016 00000100:00100000:0.0:1789776394.790550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462016 00000100:00100000:0.0:1789776394.790599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789776394.790617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449462016:12345-0@lo:400: 00000100:00100000:0.0:1789776394.790659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449462016:12345-0@lo:400: Request processed in 44us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.790665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789776394.790682:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776394.790701:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef100 x1876716449462016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776394.790711:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449462016:0@lo:400: 00000100:00100000:2.0:1789776394.792733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776394.792804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449462272:0@lo:400: 00000100:00100000:1.0:1789776394.792969:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461760 00000100:00100000:1.0:1789776394.792977:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461760 00000100:00100000:2.0:1789776394.793054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776394.793186:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462528 00000100:00100000:3.0:1789776394.793192:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462528 00000100:00100000:3.0:1789776394.793231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776394.793240:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449462528:12345-0@lo:400: 00000100:00100000:0.0:1789776394.793526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776394.793563:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449462144:0@lo:400: 00000100:00100000:0.0:1789776394.793617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776394.793638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449462656:0@lo:400: 00000100:00100000:0.0:1789776394.793671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776394.793707:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449461632 00000100:00100000:0.0:1789776394.793711:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449461632 00000100:00100000:0.0:1789776394.793740:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789776394.793746:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3644:x1876716449461632:12345-0@lo:400: 00000100:00100000:0.0:1789776394.793784:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3644:x1876716449461632:12345-0@lo:400: Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.793791:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789776394.793820:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462144 00000100:00100000:0.0:1789776394.793824:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462144 00000100:00100000:0.0:1789776394.793846:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776394.793868:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449462144:12345-0@lo:400: 00000100:00100000:0.0:1789776394.793901:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449462144:12345-0@lo:400: Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.793906:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776394.793926:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462656 00000100:00100000:0.0:1789776394.793930:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462656 00000100:00100000:0.0:1789776394.793971:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776394.793978:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449462656:12345-0@lo:400: 00000100:00100000:0.0:1789776394.794007:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449462656:12345-0@lo:400: Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776394.794013:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776394.794057:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449461632:0@lo:400: 00000100:00100000:0.0:1789776394.794071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449462144:0@lo:400: 00010000:00080000:0.0:1789776394.794081:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0b480 x1876716449462656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776394.794103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449462656:0@lo:400: 00000100:00100000:3.0:1789776394.798903:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449462528:12345-0@lo:400: Request processed in 5652us (9090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776394.798919:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789776394.799164:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0b100 x1876716449462528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776394.799180:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449462528:0@lo:400: 00000100:00100000:1.0:1789776394.801791:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462272 00000100:00100000:1.0:1789776394.801806:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462272 00000100:00100000:1.0:1789776394.802080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776394.802106:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449461760:12345-0@lo:400: 00000100:00100000:1.0:1789776394.802220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449461760:12345-0@lo:400: Request processed in 118us (9492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776394.802228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776394.802259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776394.802266:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449462272:12345-0@lo:400: 00000100:00100000:1.0:1789776394.802297:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449462272:12345-0@lo:400: Request processed in 31us (9244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776394.802303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789776394.804239:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc396680 x1876716449461760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776394.804258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449461760:0@lo:400: 00010000:00080000:3.0:1789776394.804273:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0a300 x1876716449462272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776394.804296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449462272:0@lo:400: 00000100:00080000:2.0:1789776394.809723:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776395.682845:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776396.707443:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776397.730690:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776398.370750:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449462784:0@lo:41: 00000100:00100000:3.0:1789776398.370828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776398.371029:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462784 00000100:00100000:0.0:1789776398.371037:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462784 00000100:00100000:0.0:1789776398.371089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776398.371098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449462784:12345-0@lo:41: 00000004:00000024:0.0:1789776398.371143:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789776398.371191:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449462784:12345-0@lo:41: Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776398.371198:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776398.371289:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449462784:0@lo:41: 00000100:00100000:1.0:1789776398.371616:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449462912:0@lo:41: 00000100:00100000:1.0:1789776398.371650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776398.371953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449462912 00000100:00100000:0.0:1789776398.371959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449462912 00000100:00100000:0.0:1789776398.372030:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776398.372038:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449462912:12345-0@lo:41: 00000004:00000024:0.0:1789776398.372059:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789776398.372122:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449462912:12345-0@lo:41: Request processed in 85us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776398.372129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776398.372186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449462912:0@lo:41: 00010000:00010000:0.0:1789776398.758958:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776399.778910:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776399.912169:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449463296:0@lo:400: 00000100:00100000:1.0:1789776399.912236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776399.912295:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449463808:0@lo:400: 00000100:00100000:1.0:1789776399.912326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776399.912351:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776399.912358:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449463424:0@lo:400: 00000100:00100000:1.0:1789776399.912395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776399.912424:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449463936:0@lo:400: 00000100:00100000:1.0:1789776399.912450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776399.912524:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463296 00000100:00100000:3.0:1789776399.912696:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449463040:0@lo:400: 00000100:00100000:3.0:1789776399.912735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912758:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449463552:0@lo:400: 00000100:00100000:3.0:1789776399.912779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912796:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449464064:0@lo:400: 00000100:00100000:3.0:1789776399.912820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912841:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789776399.912847:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449463168:0@lo:400: 00000100:00100000:3.0:1789776399.912868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912883:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449463680:0@lo:400: 00000100:00100000:3.0:1789776399.912903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912914:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449464192:0@lo:13: 00000100:00100000:3.0:1789776399.912949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776399.912980:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463552 00000100:00100000:3.0:1789776399.912987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463552 00000100:00100000:3.0:1789776399.913034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776399.913043:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449463552:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913098:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449463552:12345-0@lo:400: Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913105:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776399.913126:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463936 00000100:00100000:3.0:1789776399.913137:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463936 00000100:00100000:3.0:1789776399.913171:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464064 00000100:00100000:3.0:1789776399.913174:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464064 00000100:00100000:3.0:1789776399.913195:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776399.913202:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449463936:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913241:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449463936:12345-0@lo:400: Request processed in 41us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913247:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776399.913258:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776399.913263:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449464064:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913288:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449464064:12345-0@lo:400: Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913294:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776399.913314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464192 00000100:00100000:3.0:1789776399.913318:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464192 00000100:00100000:3.0:1789776399.913342:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776399.913348:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449464192:12345-0@lo:13: 00002000:00000024:3.0:1789776399.913369:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776399.913398:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449464192:12345-0@lo:13: Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913404:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789776399.913423:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776399.913462:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cc81f7480 x1876716449464192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.913522:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449464192:0@lo:13: 00000100:00100000:3.0:1789776399.913551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449463552:0@lo:400: 00010000:00080000:3.0:1789776399.913561:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff34b100 x1876716449464064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.913656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449464064:0@lo:400: 00000100:00100000:3.0:1789776399.913707:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463808 00000100:00100000:3.0:1789776399.913711:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463808 00000100:00100000:3.0:1789776399.913740:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463424 00000100:00100000:3.0:1789776399.913743:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463424 00000100:00100000:3.0:1789776399.913754:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463168 00000100:00100000:3.0:1789776399.913755:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463168 00000100:00100000:3.0:1789776399.913765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463680 00000100:00100000:3.0:1789776399.913767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463680 00000100:00100000:3.0:1789776399.913779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776399.913785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449463808:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449463808:12345-0@lo:400: Request processed in 35us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776399.913841:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776399.913847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449463424:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449463424:12345-0@lo:400: Request processed in 28us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776399.913892:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776399.913897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449463168:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449463168:12345-0@lo:400: Request processed in 29us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913932:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776399.913943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776399.913949:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449463680:12345-0@lo:400: 00000100:00100000:3.0:1789776399.913985:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449463680:12345-0@lo:400: Request processed in 36us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.913991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789776399.914009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776399.914012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789776399.914030:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff348e00 x1876716449463168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.914040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449463168:0@lo:400: 00010000:00080000:3.0:1789776399.914051:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff349180 x1876716449463680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.914059:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449463680:0@lo:400: 00010000:00080000:3.0:1789776399.914108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff348a80 x1876716449463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.914117:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449463424:0@lo:400: 00010000:00080000:3.0:1789776399.914128:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff34ad80 x1876716449463936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.914135:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449463936:0@lo:400: 00010000:00080000:3.0:1789776399.914144:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff34a300 x1876716449463808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776399.914151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449463808:0@lo:400: 00000100:00100000:0.0:1789776399.914392:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449463040 00000100:00100000:0.0:1789776399.914397:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463040 00000100:00100000:0.0:1789776399.914425:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789776399.914432:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449463040:12345-0@lo:400: 00000100:00100000:0.0:1789776399.914485:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449463040:12345-0@lo:400: Request processed in 53us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776399.914517:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789776399.914666:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449463296 00000100:00100000:1.0:1789776399.914691:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776399.914704:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449464320:0@lo:13: 00000100:00100000:1.0:1789776399.914738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776399.914780:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464320 00000100:00100000:1.0:1789776399.914784:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464320 00000100:00100000:1.0:1789776399.914810:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776399.914816:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449464320:12345-0@lo:13: 00002000:00000024:1.0:1789776399.914830:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776399.914865:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449464320:12345-0@lo:13: Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776399.914872:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789776399.914912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e2d180 x1876716449464320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776399.914926:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449464320:0@lo:13: 00000100:00100000:1.0:1789776399.914958:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449463040:0@lo:400: 00000100:00100000:3.0:1789776399.916231:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776399.916242:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449463296:12345-0@lo:400: 00000100:00100000:3.0:1789776399.916314:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449463296:12345-0@lo:400: Request processed in 74us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776399.916331:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776399.919750:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449463296:0@lo:400: 00010000:00010000:0.0:1789776400.803429:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789776401.342850:0:9508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789776401.342854:0:9508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789776401.342856:0:9508:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789776401.343237:0:9508:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5bc1a65000 00000020:01000004:2.0:1789776401.343252:0:9508:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789776401.343267:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789776401.343280:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a5bc22699b8) 00000020:00000080:2.0:1789776401.343296:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789776401.398361:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789776401.398421:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789776401.443151:0:9508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789776401.444135:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789776401.444148:0:9508:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789776401.444160:0:9508:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf13b8042cb884829 00000020:01000004:2.0:1789776401.444521:0:9508:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789776401.444544:0:9508:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789776401.444548:0:9508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789776401.444555:0:9508:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789776401.444583:0:9508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789776401.444587:0:9508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789776401.464671:0:9508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789776401.464724:0:9508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789776401.464729:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789776401.464731:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776401.464732:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776401.464734:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776401.464735:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776401.464736:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776401.464737:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776401.464739:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776401.464741:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776401.464742:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776401.464744:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776401.464748:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789776401.464750:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776401.464752:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776401.464753:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776401.464754:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776401.464755:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776401.464756:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776401.464757:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776401.464759:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776401.464760:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776401.464761:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776401.464762:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776401.464790:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789776401.464811:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449464448:0@lo:253: 00000100:00100000:3.0:1789776401.464879:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.464975:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc3980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776401.470809:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464448 00000100:00100000:0.0:1789776401.470825:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464448 00000100:00100000:0.0:1789776401.470887:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789776401.470899:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:9508:x1876716449464448:12345-0@lo:253: 20000000:01000000:0.0:1789776401.470934:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789776401.470938:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789776401.470943:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789776401.470947:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789776401.475625:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776401.475797:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789776401.475816:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789776401.475834:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789776401.475853:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789776401.475869:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789776401.475890:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789776401.476000:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789776401.476020:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:1.0:1789776401.476023:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776401.476037:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789776401.476044:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776401.476058:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789776401.476064:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776401.476077:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789776401.476084:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776401.476107:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789776401.476123:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789776401.476216:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789776401.476227:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:1.0:1789776401.476229:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776401.476244:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789776401.476248:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776401.476259:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789776401.476263:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776401.476613:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789776401.476622:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776401.476637:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789776401.476654:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789776401.477022:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789776401.477033:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:1.0:1789776401.477035:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1789776401.477048:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789776401.477053:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789776401.477065:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789776401.477074:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1789776401.477086:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789776401.477090:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776401.477101:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789776401.477114:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789776401.477126:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789776401.477128:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789776401.477132:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789776401.477176:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789776401.477178:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789776401.484651:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1789776401.484710:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1789776401.484747:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789776401.486177:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789776401.486204:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789776401.486217:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1789776401.486228:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789776401.486231:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789776401.490843:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789776401.490913:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789776401.490928:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789776401.491618:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789776401.491646:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789776401.491661:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789776401.491682:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789776401.491685:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789776401.493310:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789776401.493351:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789776401.493368:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789776401.493810:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789776401.493835:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789776401.493852:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789776401.493864:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789776401.493866:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789776401.495848:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789776401.496103:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789776401.496134:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789776401.496152:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789776401.496163:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789776401.496166:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789776401.497795:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789776401.497836:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789776401.497852:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789776401.498108:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789776401.498135:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789776401.498151:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789776401.498168:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789776401.498188:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498205:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88471f expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498213:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884749 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498220:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884788 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498227:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498234:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498240:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498247:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884814 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498254:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498311:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498325:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 21 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.498338:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464576:0@lo:104: 00000100:00100000:1.0:1789776401.498678:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.498733:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498742:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.498751:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464704:0@lo:104: 00000100:00100000:1.0:1789776401.498776:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.498799:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498807:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.498815:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464832:0@lo:104: 00000100:00100000:1.0:1789776401.498852:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.498872:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.498880:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 21 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.498900:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464960:0@lo:104: 00000100:00100000:1.0:1789776401.498922:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.498938:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.499029:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 21 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.499039:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465088:0@lo:104: 00000100:00100000:1.0:1789776401.499063:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.499083:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.499092:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 21 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.499101:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465216:0@lo:104: 00000100:00100000:1.0:1789776401.499126:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776401.499144:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.499152:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 21 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.499160:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465344:0@lo:104: 00000100:00100000:1.0:1789776401.499177:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.499271:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789776401.499288:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776401.499299:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464576 00000100:00100000:2.0:1789776401.499306:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464576 00000100:00100000:0.0:1789776401.499343:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464704 00000100:00100000:2.0:1789776401.499345:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464832 00000100:00100000:0.0:1789776401.499350:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464704 00000100:00100000:2.0:1789776401.499351:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464832 00000100:00100000:0.0:1789776401.499378:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449464960 00000100:00100000:0.0:1789776401.499382:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449464960 00000100:00100000:2.0:1789776401.499390:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465088 00000100:00100000:2.0:1789776401.499395:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465088 00000100:00100000:0.0:1789776401.499400:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465216 00000100:00100000:0.0:1789776401.499406:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465216 00000100:00100000:2.0:1789776401.499414:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465344 00000100:00100000:2.0:1789776401.499419:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465344 00000100:00100000:0.0:1789776401.499431:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776401.499451:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6510:x1876716449464576:12345-0@lo:104: 00010000:00010000:0.0:1789776401.499474:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.499678:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464576:0@lo:104: 00010000:00010000:3.0:1789776401.503814:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776401.503832:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+9:6510:x1876716449464576:12345-0@lo:104: Request processed in 4379us (5151us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776401.503837:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776401.503848:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.503866:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc11fbc20) 00000100:00100000:3.0:1789776401.503870:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:00010000:2.0:1789776401.503872:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.503886:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776401.503909:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776401.503911:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 10000000:01000000:2.0:1789776401.503921:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789776401.503926:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:6510:x1876716449464704:12345-0@lo:104: 00010000:00010000:3.0:1789776401.503942:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.504024:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776401.504029:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:6510:x1876716449464704:12345-0@lo:104: Request processed in 109us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.504035:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776401.504050:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776401.504056:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:6510:x1876716449464832:12345-0@lo:104: 00010000:00010000:3.0:1789776401.504064:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.504072:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.504081:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776401.504105:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.504113:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88481b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.504117:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789776401.504126:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:6510:x1876716449464832:12345-0@lo:104: Request processed in 70us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.504132:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789776401.504133:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776401.504138:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.504145:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc11fbc20) 00000100:00100000:3.0:1789776401.504148:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 10000000:00010000:2.0:1789776401.504150:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.504159:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776401.504166:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776401.504172:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789776401.504262:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449465472:0@lo:103: 00000100:00100000:1.0:1789776401.504309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.504688:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465472 00000100:00100000:1.0:1789776401.504697:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465472 00010000:00010000:1.0:1789776401.504724:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776401.504752:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776401.504759:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3646:x1876716449465472:12345-0@lo:103: 00010000:00010000:1.0:1789776401.504770:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776401.504775:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.504787:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.504802:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb88481b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884814 expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.504815:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776401.504850:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3646:x1876716449465472:12345-0@lo:103: Request processed in 92us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.504856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776401.504902:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449465472:0@lo:103: 00000100:00100000:1.0:1789776401.504931:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464704:0@lo:104: 00000100:00100000:1.0:1789776401.505015:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464832:0@lo:104: 00010000:00010000:2.0:1789776401.505098:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505106:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776401.505126:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505134:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb8847ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505143:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776401.505147:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505153:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776401.505156:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505163:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776401.505170:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776401.505175:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776401.505189:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505195:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776401.505200:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb8847ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505241:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776401.505242:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776401.505244:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776401.505290:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449465600:0@lo:103: 00000100:00100000:1.0:1789776401.505320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.505361:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776401.505642:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465600 00000100:00100000:2.0:1789776401.505648:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465600 00010000:00010000:2.0:1789776401.505665:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.505689:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776401.505696:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449465600:12345-0@lo:103: 00010000:00010000:2.0:1789776401.505704:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776401.505708:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505717:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505728:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb8847f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8847ea expref: 21 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.505738:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776401.505765:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3643:x1876716449465600:12345-0@lo:103: Request processed in 70us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.505772:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789776401.505842:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449465728:0@lo:103: 00000100:00100000:1.0:1789776401.505866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.505901:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449465600:0@lo:103: 00000100:00100000:2.0:1789776401.506028:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465728 00000100:00100000:2.0:1789776401.506039:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465728 00010000:00010000:2.0:1789776401.506055:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 20 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.506082:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776401.506089:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3643:x1876716449465728:12345-0@lo:103: 00010000:00010000:2.0:1789776401.506097:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776401.506102:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 20 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.506110:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 20 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.506121:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8847d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8847ce expref: 20 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.506130:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776401.506157:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3643:x1876716449465728:12345-0@lo:103: Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.506162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776401.506222:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449465728:0@lo:103: 00000100:00100000:3.0:1789776401.506270:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6510:x1876716449464960:12345-0@lo:104: 00010000:00010000:3.0:1789776401.506284:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.506344:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776401.506350:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:6510:x1876716449464960:12345-0@lo:104: Request processed in 2194us (7427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.506364:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776401.506381:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789776401.506387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6510:x1876716449465088:12345-0@lo:104: 00010000:00010000:3.0:1789776401.506396:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.506428:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789776401.506433:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:6510:x1876716449465088:12345-0@lo:104: Request processed in 46us (7370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.506452:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789776401.506465:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776401.506471:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6510:x1876716449465216:12345-0@lo:104: 00010000:00010000:3.0:1789776401.506478:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.506521:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789776401.506537:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6510:x1876716449465216:12345-0@lo:104: Request processed in 56us (7400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.506543:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776401.506574:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776401.506581:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6510:x1876716449465344:12345-0@lo:104: 00010000:00010000:3.0:1789776401.506589:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508040:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789776401.508053:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6510:x1876716449465344:12345-0@lo:104: Request processed in 1469us (8760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.508085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789776401.508117:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789776401.508124:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508134:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030a00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776401.508138:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508148:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776401.508163:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776401.508168:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776401.508208:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508215:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776401.508229:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508236:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb8847a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508248:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789776401.508251:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508266:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fe00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776401.508269:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508276:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776401.508282:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776401.508287:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776401.508297:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508303:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776401.508308:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508315:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb884788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88478f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508323:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776401.508326:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508332:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0e00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776401.508335:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508350:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776401.508357:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776401.508362:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776401.508372:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508378:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776401.508385:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508392:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb884749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884750 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508403:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776401.508406:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508411:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776401.508414:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508420:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776401.508426:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776401.508447:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776401.508468:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508474:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776401.508479:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508485:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fa00/0xf13b8042cb88471f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884726 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.508527:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776401.508529:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776401.508530:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776401.508541:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776401.509783:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449466240:0@lo:103: 00000100:00100000:0.0:1789776401.509842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.509877:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776401.509882:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449466112:0@lo:103: 00000100:00100000:0.0:1789776401.509899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.509925:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449465856:0@lo:103: 00000100:00100000:0.0:1789776401.509941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.509954:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776401.509958:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449465984:0@lo:103: 00000100:00100000:0.0:1789776401.509972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776401.509985:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776401.509999:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466240 00000100:00100000:0.0:1789776401.510005:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466240 00010000:00010000:0.0:1789776401.510028:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 19 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.510047:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466112 00000100:00100000:0.0:1789776401.510049:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466112 00010000:00010000:0.0:1789776401.510059:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 20 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.510070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465856 00000100:00100000:0.0:1789776401.510072:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465856 00000100:00100000:2.0:1789776401.510087:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449464960:0@lo:104: 00010000:00010000:0.0:1789776401.510096:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 21 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.510103:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465088:0@lo:104: 00000100:00100000:2.0:1789776401.510113:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465216:0@lo:104: 00000100:00100000:2.0:1789776401.510129:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876716449465344:0@lo:104: 00000100:00100000:0.0:1789776401.510130:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449465984 00000100:00100000:0.0:1789776401.510135:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449465984 00010000:00010000:0.0:1789776401.510148:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.510170:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.510171:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776401.510182:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfae82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3644:x1876716449466240:12345-0@lo:103: 00010000:00010000:0.0:1789776401.510195:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.510200:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510210:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510225:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc256c00/0xf13b8042cb884726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88471f expref: 22 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510239:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776401.510276:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfae82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3644:x1876716449466240:12345-0@lo:103: Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.510283:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776401.510323:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776401.510329:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3644:x1876716449466112:12345-0@lo:103: 00010000:00010000:0.0:1789776401.510335:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.510339:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 20 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510347:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 20 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510362:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb884750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884749 expref: 20 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510371:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776401.510389:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3644:x1876716449466112:12345-0@lo:103: Request processed in 61us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.510395:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776401.510405:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776401.510411:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3645:x1876716449465856:12345-0@lo:103: 00010000:00010000:0.0:1789776401.510417:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.510421:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 18 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510428:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 18 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510449:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c0c00/0xf13b8042cb8847ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8847a4 expref: 18 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510457:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776401.510481:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:3645:x1876716449465856:12345-0@lo:103: Request processed in 70us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.510487:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776401.510518:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789776401.510539:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3645:x1876716449465984:12345-0@lo:103: 00010000:00010000:0.0:1789776401.510547:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.510551:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510566:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510575:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257600/0xf13b8042cb88478f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884788 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510586:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.510594:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.510614:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449466112:0@lo:103: 00000100:00100000:2.0:1789776401.510634:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449466240:0@lo:103: 00010000:00010000:0.0:1789776401.511323:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511334:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511341:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511348:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511355:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776401.511359:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511367:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511405:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.511415:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776401.511453:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.511464:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.511467:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3645:x1876716449465984:12345-0@lo:103: Request processed in 940us (1491us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776401.511481:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c0800/0xf13b8042cb884830 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.511483:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:2.0:1789776401.511550:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789776401.511980:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449465984:0@lo:103: 00000100:00100000:0.0:1789776401.511991:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449465856:0@lo:103: 00000100:00100000:1.0:1789776401.515138:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:9508:x1876716449464448:12345-0@lo:253: Request processed in 44231us (50248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.515151:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789776401.515269:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449464448:0@lo:253: 10000000:01000000:3.0:1789776401.515285:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789776401.515289:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776401.515292:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776401.515293:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776401.515295:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789776401.515297:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776401.515298:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776401.515300:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776401.515301:0:9508:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789776401.515303:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776401.515304:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776401.515330:0:9508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc1a65000 from lustre-OST0001 10000000:01000000:3.0:1789776401.515361:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789776401.515378:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776401.515388:0:9508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5cc8c63370 local copy 10000000:01000000:3.0:1789776401.515402:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789776401.515450:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.515461:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.515471:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776401.515506:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466368:0@lo:101: 00000100:00100000:3.0:1789776401.515828:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.515871:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776401.515923:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466368 00000100:00100000:1.0:1789776401.515929:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466368 00000100:00100000:1.0:1789776401.515988:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789776401.515997:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+14:9508:x1876716449466368:12345-0@lo:101: 00010000:00010000:1.0:1789776401.516011:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776401.516026:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0200/0xf13b8042cb88483e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884837 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.516049:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0200/0xf13b8042cb88483e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884837 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.516061:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c0200/0xf13b8042cb88483e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884837 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.516071:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0200, rc 0) 00000100:00100000:1.0:1789776401.516103:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466368:12345-0@lo:101: Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.516110:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789776401.516257:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466368:0@lo:101: 00010000:00010000:3.0:1789776401.516272:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.516281:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776401.516387:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466496:0@lo:501: 00000100:00100000:3.0:1789776401.516415:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.516450:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776401.516562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466496 00000100:00100000:1.0:1789776401.516567:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466496 00000100:00100000:1.0:1789776401.516604:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789776401.516610:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466496:12345-0@lo:501: 00000100:00100000:1.0:1789776401.516672:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466496:12345-0@lo:501: Request processed in 61us (255us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776401.516679:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789776401.516830:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466496:0@lo:501: 10000000:01000000:3.0:1789776401.516843:0:9508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789776401.516861:0:9508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789776401.516866:0:9508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.516884:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.516891:0:9508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.516911:0:9508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789776401.516933:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5bc1a65000 10000000:01000000:3.0:1789776401.517004:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789776401.517011:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776401.517014:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789776401.517018:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789776401.517021:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789776401.517037:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.517044:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.517050:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776401.517061:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466624:0@lo:101: 00000100:00100000:3.0:1789776401.517087:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.517119:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776401.517173:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466624 00000100:00100000:1.0:1789776401.517177:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466624 00000100:00100000:1.0:1789776401.517209:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789776401.517216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466624:12345-0@lo:101: 00010000:00010000:1.0:1789776401.517223:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776401.517232:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884845 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.517245:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884845 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.517254:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884845 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.517262:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776401.517291:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449466624:12345-0@lo:101: Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.517296:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789776401.519580:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466624:0@lo:101: 00010000:00010000:3.0:1789776401.519615:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.519658:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.519931:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776401.519940:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.519949:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776401.519954:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.519963:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776401.519972:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776401.519978:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776401.520011:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.520018:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776401.520049:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.520057:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb884837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf13b8042cb88483e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.520071:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776401.520085:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776401.520088:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776401.520144:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466880:0@lo:501: 00000100:00100000:2.0:1789776401.520153:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449466752:0@lo:103: 00000100:00100000:2.0:1789776401.526429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.526678:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466752 00000100:00100000:1.0:1789776401.526687:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466752 00000100:00100000:1.0:1789776401.526754:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776401.526765:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:3645:x1876716449466752:12345-0@lo:103: 00010000:00010000:1.0:1789776401.526780:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776401.526813:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c0200/0xf13b8042cb88483e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884837 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776401.526828:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776401.526882:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3645:x1876716449466752:12345-0@lo:103: Request processed in 119us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.526889:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776401.527204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449466752:0@lo:103: 00000100:00100000:3.0:1789776401.527542:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.527579:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776401.527628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449466880 00000100:00100000:1.0:1789776401.527634:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449466880 00000100:00100000:1.0:1789776401.527670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789776401.527676:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466880:12345-0@lo:501: 00000100:00100000:1.0:1789776401.527804:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449466880:12345-0@lo:501: Request processed in 127us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.527810:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789776401.527959:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449466880:0@lo:501: 00000100:00100000:3.0:1789776401.528003:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467008:0@lo:503: 00000100:00100000:3.0:1789776401.528054:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.528079:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776401.528657:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467008 00000100:00100000:1.0:1789776401.528665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467008 00000100:00100000:1.0:1789776401.528705:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789776401.528711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467008:12345-0@lo:503: 00000100:00100000:1.0:1789776401.528822:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467008:12345-0@lo:503: Request processed in 110us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.528829:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789776401.529181:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467008:0@lo:503: 00000040:00080000:3.0:1789776401.529486:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776401.529774:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467136:0@lo:502: 00000100:00100000:1.0:1789776401.529826:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.529866:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776401.529912:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467136 00000100:00100000:0.0:1789776401.529918:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467136 00000100:00100000:0.0:1789776401.529959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789776401.529968:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467136:12345-0@lo:502: 00000100:00100000:0.0:1789776401.530069:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467136:12345-0@lo:502: Request processed in 102us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.530087:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789776401.530274:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467136:0@lo:502: 00000040:00080000:1.0:1789776401.530754:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789776401.530784:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789776401.530806:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789776401.530819:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789776401.530832:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789776401.530844:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789776401.530870:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467264:0@lo:502: 00000100:00100000:1.0:1789776401.530909:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.530946:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.531336:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467264 00000100:00100000:3.0:1789776401.531343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467264 00000100:00100000:3.0:1789776401.531386:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789776401.531394:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467264:12345-0@lo:502: 00000100:00100000:3.0:1789776401.532288:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467264:12345-0@lo:502: Request processed in 892us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.532297:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789776401.532452:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467264:0@lo:502: 00000040:00080000:1.0:1789776401.532556:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789776401.532567:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789776401.533183:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789776401.533267:0:9519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789776401.533276:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776401.533279:0:9519:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789776401.533287:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776401.533316:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a5bc2738000) 00000020:00000080:1.0:1789776401.533345:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789776401.533367:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789776401.533573:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc1a65000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789776401.533582:0:9519:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789776401.533590:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf13b8042cb88485a 00010000:00010000:3.0:1789776401.550179:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789776401.550487:0:9519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789776401.556935:0:9519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789776401.557292:0:9519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789776401.563366:0:9519:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789776401.563916:0:9519:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789776401.586228:0:9519:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789776401.590543:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789776401.590557:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776401.590565:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776401.590567:0:9519:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789776401.590571:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776401.590575:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776401.590576:0:9519:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776401.590580:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776401.590582:0:9519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789776401.590619:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776401.590623:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776401.590624:0:9519:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789776401.590627:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789776401.591338:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789776401.591370:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789776401.591396:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.591409:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776401.591417:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc1a65000 from 1 10000000:01000000:2.0:1789776401.591420:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776401.591464:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.591472:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.591531:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.591556:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467392:0@lo:101: 00000100:00100000:2.0:1789776401.591630:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776401.591667:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc3980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.592793:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467392 00000100:00100000:3.0:1789776401.592805:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467392 00000100:00100000:3.0:1789776401.592854:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789776401.592864:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:9508:x1876716449467392:12345-0@lo:101: 00010000:00010000:3.0:1789776401.592878:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776401.592892:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884861 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.592918:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884861 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.592929:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884861 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.592938:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257400, rc 0) 00000100:00100000:3.0:1789776401.592991:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467392:12345-0@lo:101: Request processed in 128us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.592998:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789776401.593875:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467392:0@lo:101: 00010000:00010000:2.0:1789776401.593899:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.593910:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776401.594043:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467520:0@lo:501: 00000100:00100000:2.0:1789776401.594523:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776401.594732:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc3980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.594857:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467520 00000100:00100000:3.0:1789776401.594865:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467520 00000100:00100000:3.0:1789776401.594901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789776401.594909:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467520:12345-0@lo:501: 00000100:00100000:3.0:1789776401.595028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467520:12345-0@lo:501: Request processed in 119us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.595035:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789776401.595250:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467520:0@lo:501: 00000100:00100000:0.0:1789776401.595287:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467648:0@lo:503: 00000100:00100000:0.0:1789776401.595407:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.595451:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.595520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467648 00000100:00100000:2.0:1789776401.595524:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467648 00000100:00100000:2.0:1789776401.595563:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789776401.595569:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467648:12345-0@lo:503: 00000100:00100000:2.0:1789776401.595783:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467648:12345-0@lo:503: Request processed in 214us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.595790:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789776401.595938:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467648:0@lo:503: 00000040:00080000:0.0:1789776401.596384:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789776401.596457:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467776:0@lo:502: 00000100:00100000:0.0:1789776401.597279:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.597320:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.597383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467776 00000100:00100000:2.0:1789776401.597389:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467776 00000100:00100000:2.0:1789776401.597431:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789776401.597448:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467776:12345-0@lo:502: 00000100:00100000:2.0:1789776401.599862:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467776:12345-0@lo:502: Request processed in 2407us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.599876:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789776401.606238:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467776:0@lo:502: 00000040:00080000:0.0:1789776401.608270:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789776401.608321:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789776401.608367:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467904:0@lo:502: 00000100:00100000:0.0:1789776401.608459:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.612138:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.613188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449467904 00000100:00100000:2.0:1789776401.613199:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449467904 00000100:00100000:2.0:1789776401.613256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789776401.613265:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467904:12345-0@lo:502: 00000100:00100000:2.0:1789776401.613517:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449467904:12345-0@lo:502: Request processed in 228us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.613533:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789776401.613918:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449467904:0@lo:502: 00000040:00080000:0.0:1789776401.613997:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789776401.614011:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789776401.614873:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776401.614882:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776401.614885:0:9523:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789776401.614890:0:9523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc1a65000 00000020:00000080:2.0:1789776401.614893:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776401.614903:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776401.614906:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776401.614907:0:9523:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789776401.614909:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789776401.615068:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789776401.615218:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776401.615273:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.615285:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776401.615335:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789776401.615338:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5bc1a65000 10000000:01000000:0.0:1789776401.615342:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5bc1a65000 10000000:01000000:0.0:1789776401.615346:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776401.615352:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc1a65000 from 1 10000000:01000000:0.0:1789776401.615355:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776401.615386:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.615395:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.615405:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.615431:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468032:0@lo:101: 00000100:00100000:0.0:1789776401.615695:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.615734:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.615874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468032 00000100:00100000:2.0:1789776401.615881:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468032 00000100:00100000:2.0:1789776401.615924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789776401.615933:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9508:x1876716449468032:12345-0@lo:101: 00010000:00010000:2.0:1789776401.615945:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776401.615958:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88486f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.615982:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88486f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.616006:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88486f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.616016:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fa00, rc 0) 00000100:00100000:2.0:1789776401.616066:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468032:12345-0@lo:101: Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.616144:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789776401.616313:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468032:0@lo:101: 00010000:00010000:3.0:1789776401.616328:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.616335:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776401.616413:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468160:0@lo:501: 00000100:00100000:3.0:1789776401.616457:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.616487:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776401.616748:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468160 00000100:00100000:0.0:1789776401.616752:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468160 00000100:00100000:0.0:1789776401.616781:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789776401.616787:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468160:12345-0@lo:501: 00000100:00100000:0.0:1789776401.616892:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468160:12345-0@lo:501: Request processed in 104us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.616898:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789776401.617149:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468160:0@lo:501: 00000100:00100000:3.0:1789776401.617182:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468288:0@lo:503: 00000100:00100000:3.0:1789776401.617223:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.617288:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776401.617775:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468288 00000100:00100000:0.0:1789776401.617781:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468288 00000100:00100000:0.0:1789776401.617855:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789776401.617863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468288:12345-0@lo:503: 00000100:00100000:0.0:1789776401.617960:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468288:12345-0@lo:503: Request processed in 97us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.617967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789776401.618030:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468288:0@lo:503: 00000040:00080000:1.0:1789776401.618245:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776401.618304:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468416:0@lo:502: 00000100:00100000:1.0:1789776401.618341:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.618557:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.618762:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468416 00000100:00100000:3.0:1789776401.618768:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468416 00000100:00100000:3.0:1789776401.618792:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789776401.618799:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468416:12345-0@lo:502: 00000100:00100000:3.0:1789776401.618891:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468416:12345-0@lo:502: Request processed in 92us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.618907:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789776401.618987:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468416:0@lo:502: 00000040:00080000:1.0:1789776401.619177:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789776401.619202:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789776401.619225:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789776401.619240:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789776401.619253:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789776401.619265:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789776401.619278:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789776401.619289:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789776401.619304:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789776401.619318:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789776401.619331:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789776401.619345:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789776401.619357:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789776401.619371:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789776401.619384:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789776401.619399:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789776401.619413:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789776401.619426:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789776401.619452:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789776401.619469:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789776401.619484:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789776401.619540:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789776401.619557:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789776401.619571:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789776401.619584:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789776401.619598:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789776401.619745:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789776401.619764:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789776401.619779:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789776401.619792:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789776401.619809:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789776401.619824:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789776401.619838:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789776401.619853:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789776401.619868:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789776401.619893:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789776401.619908:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789776401.619922:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789776401.619935:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789776401.619948:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789776401.619961:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789776401.619975:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789776401.619989:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789776401.620018:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789776401.620031:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789776401.620054:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789776401.620099:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468544:0@lo:502: 00000100:00100000:1.0:1789776401.620145:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.620186:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.620331:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468544 00000100:00100000:3.0:1789776401.620338:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468544 00000100:00100000:3.0:1789776401.620365:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789776401.620371:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468544:12345-0@lo:502: 00000100:00100000:3.0:1789776401.620480:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449468544:12345-0@lo:502: Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.620487:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789776401.620778:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449468544:0@lo:502: 00000040:00080000:1.0:1789776401.620825:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789776401.620834:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789776401.621330:0:9524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789776401.621345:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a5bc27399b8) 00000020:00000080:1.0:1789776401.621368:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789776401.621457:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc1a65000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789776401.621462:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc1a65000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789776401.621464:0:9524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc1a65000 3 00010000:00080000:1.0:1789776401.621519:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cd93f7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776401.624874:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789776401.625182:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789776401.625235:0:9524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776401.625250:0:9524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf13b8042cb884884 00000100:00080000:2.0:1789776401.625260:0:9524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776401.625267:0:9524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a5cd93f7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776401.625306:0:9524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cf5e08e00 x1876716449468672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776401.625341:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789776401.625545:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449468672:0@lo:38: 00000100:00100000:3.0:1789776401.625629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789776401.625854:0:9524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789776401.625869:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a5cff3b0000) 00000020:00000080:3.0:1789776401.625885:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789776401.625957:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc1a65000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776401.625962:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc1a65000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776401.625964:0:9524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc1a65000 3 00010000:00080000:3.0:1789776401.625990:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc2529000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1789776401.627638:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:0.0:1789776401.627863:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449469184:0@lo:400: 00000100:00100000:0.0:1789776401.627919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.627950:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449469696:0@lo:400: 00000100:00100000:0.0:1789776401.627974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.627999:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776401.628004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449468800:0@lo:400: 00000100:00100000:0.0:1789776401.628028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449469312:0@lo:400: 00000100:00100000:0.0:1789776401.628072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628099:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449469056:0@lo:400: 00000100:00100000:0.0:1789776401.628121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628132:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449469568:0@lo:400: 00000100:00100000:0.0:1789776401.628150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789776401.628175:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449468928:0@lo:400: 00000100:00100000:0.0:1789776401.628195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628211:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449469440:0@lo:400: 00000100:00100000:0.0:1789776401.628229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.628253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469184 00000100:00100000:0.0:1789776401.628260:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469184 00000100:00100000:0.0:1789776401.628297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468928 00000100:00100000:0.0:1789776401.628301:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468928 00000100:00100000:0.0:1789776401.628315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776401.628322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449469184:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628381:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449469184:12345-0@lo:400: Request processed in 58us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776401.628403:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776401.628409:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449468928:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628451:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449468928:12345-0@lo:400: Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628457:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776401.628474:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469696 00000100:00100000:0.0:1789776401.628477:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469696 00000100:00100000:0.0:1789776401.628538:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469568 00000100:00100000:0.0:1789776401.628547:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469568 00000100:00100000:0.0:1789776401.628573:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776401.628580:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449469696:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628610:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449469696:12345-0@lo:400: Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628616:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776401.628627:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789776401.628632:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449469568:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628658:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449469568:12345-0@lo:400: Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628664:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789776401.628681:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468672 00000100:00100000:0.0:1789776401.628684:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468672 00000100:00100000:0.0:1789776401.628696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449468800 00000100:00100000:0.0:1789776401.628698:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449468800 00000100:00100000:0.0:1789776401.628712:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469312 00000100:00100000:0.0:1789776401.628714:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469312 00000100:00100000:0.0:1789776401.628726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469056 00000100:00100000:0.0:1789776401.628728:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469056 00000100:00100000:0.0:1789776401.628738:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469440 00000100:00100000:0.0:1789776401.628740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469440 00000100:00100000:0.0:1789776401.628768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776401.628775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449468800:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449468800:12345-0@lo:400: Request processed in 31us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776401.628823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776401.628829:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449469312:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628854:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449469312:12345-0@lo:400: Request processed in 25us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628865:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776401.628877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776401.628882:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449469056:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628911:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449469056:12345-0@lo:400: Request processed in 28us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776401.628927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776401.628933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449469440:12345-0@lo:400: 00000100:00100000:0.0:1789776401.628956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449469440:12345-0@lo:400: Request processed in 24us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.628962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776401.628973:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776401.628976:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449468672:12345-0@lo:38: 00010000:00080000:0.0:1789776401.628996:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1789776401.629026:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf13b8042cb884892 00000004:00100000:0.0:1789776401.629042:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789776401.629071:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776401.629113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876716449468672:12345-0@lo:38: Request processed in 134us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.629119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789776401.629151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776401.629155:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776401.629157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776401.629202:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e08e00 x1876716449468672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629213:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776401.629227:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789776401.629235:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789776401.629240:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789776401.629243:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776401.629248:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449468672:0@lo:38: 00000100:00100000:0.0:1789776401.629281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449468928:0@lo:400: 00010000:00080000:0.0:1789776401.629293:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedceea00 x1876716449469440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629303:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449469440:0@lo:400: 00010000:00080000:0.0:1789776401.629312:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e2f480 x1876716449469056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629321:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449469056:0@lo:400: 00010000:00080000:0.0:1789776401.629330:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cedcef100 x1876716449469568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629338:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449469568:0@lo:400: 00010000:00080000:0.0:1789776401.629372:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e2e680 x1876716449468800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449468800:0@lo:400: 00010000:00080000:0.0:1789776401.629390:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e2ea00 x1876716449469312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629398:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449469312:0@lo:400: 00000100:00100000:0.0:1789776401.629407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449469184:0@lo:400: 00010000:00080000:0.0:1789776401.629428:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cfc395f80 x1876716449469696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.629451:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449469696:0@lo:400: 00000100:00100000:2.0:1789776401.630626:0:9525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9525:1876716449469824:0@lo:901: 00000100:00100000:2.0:1789776401.630695:0:9525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776401.630734:0:9525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776401.630808:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469824 00000100:00100000:0.0:1789776401.630814:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469824 00000100:00100000:0.0:1789776401.630873:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776401.630882:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1876716449469824:12345-0@lo:901: 00000100:00100000:0.0:1789776401.630974:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1876716449469824:12345-0@lo:901: Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.630981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789776401.631014:0:9525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e08000 x1876716449469824/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789776417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.631025:0:9525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9525:1876716449469824:0@lo:901: 00000100:00080000:2.0:1789776401.631217:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789776401.631453:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789776401.631560:0:9524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789776401.631572:0:9524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf13b8042cb884899 00000100:00080000:3.0:1789776401.631579:0:9524:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776401.631583:0:9524:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a5bc2529000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776401.631604:0:9524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff35ca80 x1876716449469952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776401.631631:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449469952:0@lo:38: 00000100:00100000:3.0:1789776401.631690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.631737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449469952 00000100:00100000:3.0:1789776401.631742:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449469952 00000100:00100000:3.0:1789776401.631768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776401.631773:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449469952:12345-0@lo:38: 00010000:00080000:3.0:1789776401.631792:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1789776401.631835:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf13b8042cb8848a0 00000004:00100000:3.0:1789776401.631850:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776401.631876:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2528000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776401.634044:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876716449469952:12345-0@lo:38: Request processed in 2261us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776401.634060:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789776401.634101:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789776401.634534:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789776401.634593:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789776401.634621:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776401.634638:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776401.634649:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776401.634700:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776401.634703:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776401.634704:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776401.634705:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776401.634706:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776401.634708:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776401.634709:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776401.634711:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776401.634716:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776401.634718:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776401.634719:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776401.634722:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789776401.634724:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776401.634725:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776401.634726:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776401.634727:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776401.634728:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776401.634729:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776401.634730:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776401.634731:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776401.634732:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776401.634733:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776401.634733:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776401.634758:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789776401.634773:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449470080:0@lo:253: 00000100:00100000:3.0:1789776401.634836:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776401.634864:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4e74480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776401.634887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470080 00000100:00100000:3.0:1789776401.634893:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470080 00000100:00100000:3.0:1789776401.634930:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789776401.634938:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449470080:12345-0@lo:253: 20000000:01000000:3.0:1789776401.634964:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789776401.634979:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789776401.635329:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff35ca80 x1876716449469952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776401.635341:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776401.635350:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789776401.635357:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789776401.635361:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789776401.635372:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2529000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776401.635379:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449469952:0@lo:38: 20000000:01000000:2.0:1789776401.645331:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789776401.645379:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789776401.645784:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9508:x1876716449470080:12345-0@lo:253: Request processed in 10843us (10944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.645797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789776401.645957:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9508:1876716449470080:0@lo:253: 10000000:01000000:1.0:1789776401.645970:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789776401.645973:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776401.645975:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776401.645976:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776401.645977:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776401.645987:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776401.645988:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776401.645990:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776401.645991:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776401.645993:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776401.645995:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776401.645996:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789776401.646011:0:9508:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789776401.648939:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789776401.648949:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789776401.648977:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.648996:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884796 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649004:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649011:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649052:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649080:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 16 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.649096:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449470208:0@lo:104: 00000100:00100000:0.0:1789776401.649158:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776401.649226:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649235:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 16 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.649243:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449470336:0@lo:104: 00000100:00100000:0.0:1789776401.649265:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.649291:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776401.649357:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470208 00000100:00100000:2.0:1789776401.649365:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470208 00000100:00100000:2.0:1789776401.649401:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470336 00000100:00100000:2.0:1789776401.649405:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470336 00000100:00100000:2.0:1789776401.649419:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776401.649429:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6532:x1876716449470208:12345-0@lo:104: 00010000:00010000:2.0:1789776401.649456:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.649540:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776401.649546:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:6532:x1876716449470208:12345-0@lo:104: Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.649553:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776401.649570:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776401.649575:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449470336:12345-0@lo:104: 00010000:00010000:2.0:1789776401.649583:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776401.649681:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776401.649686:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:6532:x1876716449470336:12345-0@lo:104: Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776401.649702:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789776401.649763:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789776401.649769:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649777:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257e00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776401.649782:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649790:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776401.649797:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776401.649803:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776401.649844:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649851:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776401.649870:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649877:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257e00/0xf13b8042cb8847dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8847e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649890:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776401.649893:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649898:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776401.649901:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649908:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776401.649913:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776401.649918:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776401.649930:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649935:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776401.649948:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649966:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030600/0xf13b8042cb884796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88479d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.649978:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776401.649980:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776401.649982:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776401.649993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449470464:0@lo:103: 00000100:00100000:0.0:1789776401.650023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.650061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449470592:0@lo:103: 00000100:00100000:0.0:1789776401.650083:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.650112:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470464 00000100:00100000:0.0:1789776401.650117:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470464 00010000:00010000:0.0:1789776401.650135:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 17 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.650156:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470592 00000100:00100000:0.0:1789776401.650159:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470592 00010000:00010000:0.0:1789776401.650169:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 18 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.650189:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789776401.650195:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3646:x1876716449470464:12345-0@lo:103: 00010000:00010000:0.0:1789776401.650205:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.650210:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 18 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650220:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 18 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650242:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776401.650270:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:3646:x1876716449470464:12345-0@lo:103: Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.650276:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789776401.650292:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776401.650298:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:3643:x1876716449470592:12345-0@lo:103: 00010000:00010000:0.0:1789776401.650305:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776401.650309:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 17 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650317:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 17 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650328:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650336:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776401.650349:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002483506s 00010000:00010000:0.0:1789776401.650354:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650361:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650367:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650373:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650384:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776401.650389:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650395:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650403:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.650411:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776401.650454:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:3643:x1876716449470592:12345-0@lo:103: Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.650460:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776401.650523:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449470592:0@lo:103: 00000100:00100000:0.0:1789776401.650550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449470464:0@lo:103: 00010000:00010000:0.0:1789776401.650568:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8847e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8847dc expref: 16 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.650578:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449470208:0@lo:104: 00010000:00010000:0.0:1789776401.650586:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb88479d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884796 expref: 15 pid: 6510 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776401.650593:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876716449470336:0@lo:104: 00010000:00010000:3.0:1789776401.650788:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776401.651860:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.651890:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.651897:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776401.651903:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030400/0xf13b8042cb8848a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789776401.653098:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789776401.653256:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789776401.653465:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789776401.656448:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789776401.657312:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789776401.657811:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789776401.659042:0:9508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789776401.670186:0:9508:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789776401.670198:0:9508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789776401.670255:0:9508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776401.670304:0:9508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776401.670327:0:9508:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789776401.670350:0:9508:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789776401.671466:0:9508:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776401.674951:0:9508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789776401.827668:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776402.540014:0:9580:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776402.542075:0:9580:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789776402.850775:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776403.490716:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449470720:0@lo:41: 00000100:00100000:0.0:1789776403.490793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776403.490849:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470720 00000100:00100000:0.0:1789776403.490856:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470720 00000100:00100000:0.0:1789776403.490898:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789776403.490906:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449470720:12345-0@lo:41: 00000004:00000024:0.0:1789776403.490938:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789776403.490983:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449470720:12345-0@lo:41: Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776403.490990:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789776403.491035:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449470720:0@lo:41: 00000100:00100000:0.0:1789776403.491542:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449470848:0@lo:41: 00000100:00100000:0.0:1789776403.491579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776403.491620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470848 00000100:00100000:0.0:1789776403.491625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470848 00000100:00100000:0.0:1789776403.491656:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789776403.491672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449470848:12345-0@lo:41: 00000004:00000024:0.0:1789776403.491697:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789776403.491741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449470848:12345-0@lo:41: Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776403.491750:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776403.491764:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449470848:0@lo:41: 00010000:00010000:3.0:1789776403.874630:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776404.900155:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776405.026715:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776405.026740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449470976:0@lo:13: 00000100:00100000:3.0:1789776405.026818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776405.026889:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449470976 00000100:00100000:3.0:1789776405.026897:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449470976 00000100:00100000:3.0:1789776405.026950:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789776405.026960:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449470976:12345-0@lo:13: 00002000:00000024:3.0:1789776405.027003:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776405.027047:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449470976:12345-0@lo:13: Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776405.027053:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789776405.027073:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776405.027103:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449470976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776405.027120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449470976:0@lo:13: 00000100:00100000:2.0:1789776405.027910:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449471104:0@lo:13: 00000100:00100000:2.0:1789776405.027946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776405.028457:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471104 00000100:00100000:3.0:1789776405.028463:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471104 00000100:00100000:3.0:1789776405.028547:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776405.028555:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449471104:12345-0@lo:13: 00002000:00000024:3.0:1789776405.028571:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776405.028614:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449471104:12345-0@lo:13: Request processed in 60us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776405.028621:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789776405.028804:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776405.028907:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815ea00 x1876716449471104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776405.028924:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449471104:0@lo:13: 00010000:00010000:2.0:1789776405.923408:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776406.948270:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776407.075095:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449471232:0@lo:400: 00000100:00100000:2.0:1789776407.075170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776407.075216:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449471744:0@lo:400: 00000100:00100000:2.0:1789776407.075244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776407.075262:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449472256:0@lo:400: 00000100:00100000:2.0:1789776407.075286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776407.075312:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789776407.075319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449471616:0@lo:400: 00000100:00100000:2.0:1789776407.075356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776407.075375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449472128:0@lo:400: 00000100:00100000:2.0:1789776407.075396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776407.075428:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471232 00000100:00100000:2.0:1789776407.075435:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471232 00000100:00100000:2.0:1789776407.075566:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789776407.075575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3644:x1876716449471232:12345-0@lo:400: 00000100:00100000:2.0:1789776407.075641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3644:x1876716449471232:12345-0@lo:400: Request processed in 66us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776407.075648:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789776407.075682:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471744 00000100:00100000:2.0:1789776407.075695:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471744 00000100:00100000:2.0:1789776407.075726:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776407.075733:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449471744:12345-0@lo:400: 00000100:00100000:2.0:1789776407.075766:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449471744:12345-0@lo:400: Request processed in 35us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776407.075772:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776407.075792:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472256 00000100:00100000:2.0:1789776407.075795:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472256 00000100:00100000:2.0:1789776407.075830:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472128 00000100:00100000:2.0:1789776407.075834:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472128 00000100:00100000:2.0:1789776407.075855:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776407.075861:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449472256:12345-0@lo:400: 00000100:00100000:2.0:1789776407.075890:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449472256:12345-0@lo:400: Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776407.075896:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776407.075907:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776407.075913:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449472128:12345-0@lo:400: 00000100:00100000:2.0:1789776407.075939:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449472128:12345-0@lo:400: Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776407.075944:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776407.075961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471616 00000100:00100000:2.0:1789776407.075964:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471616 00000100:00100000:2.0:1789776407.075991:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776407.075997:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449471616:12345-0@lo:400: 00000100:00100000:2.0:1789776407.076026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449471616:12345-0@lo:400: Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776407.076032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789776407.076058:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776407.076105:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf63480 x1876716449471616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776407.076120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449471616:0@lo:400: 00010000:00080000:2.0:1789776407.076130:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf60000 x1876716449472128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776407.076138:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449472128:0@lo:400: 00000100:00100000:2.0:1789776407.076145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449471232:0@lo:400: 00000100:00100000:2.0:1789776407.076154:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449471744:0@lo:400: 00010000:00080000:2.0:1789776407.076163:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf60700 x1876716449472256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776407.076171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449472256:0@lo:400: 00000100:00100000:1.0:1789776407.076375:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449471360:0@lo:400: 00000100:00100000:1.0:1789776407.076408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076526:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449471872:0@lo:400: 00000100:00100000:1.0:1789776407.076553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449472384:0@lo:400: 00000100:00100000:1.0:1789776407.076599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076725:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789776407.076740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449471488:0@lo:400: 00000100:00100000:1.0:1789776407.076766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076786:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449472000:0@lo:400: 00000100:00100000:1.0:1789776407.076808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076818:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449472512:0@lo:400: 00000100:00100000:1.0:1789776407.076839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776407.076864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471488 00000100:00100000:1.0:1789776407.076868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471488 00000100:00100000:1.0:1789776407.076899:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776407.076905:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449471488:12345-0@lo:400: 00000100:00100000:1.0:1789776407.076942:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449471488:12345-0@lo:400: Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.076948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776407.076977:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471360 00000100:00100000:1.0:1789776407.076981:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471360 00000100:00100000:1.0:1789776407.076995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449471872 00000100:00100000:1.0:1789776407.076997:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449471872 00000100:00100000:1.0:1789776407.077014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472384 00000100:00100000:1.0:1789776407.077017:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472384 00000100:00100000:1.0:1789776407.077029:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472000 00000100:00100000:1.0:1789776407.077032:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472000 00000100:00100000:1.0:1789776407.077043:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472512 00000100:00100000:1.0:1789776407.077045:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472512 00000100:00100000:1.0:1789776407.077057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776407.077063:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449471360:12345-0@lo:400: 00000100:00100000:1.0:1789776407.077095:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449471360:12345-0@lo:400: Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.077101:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776407.077116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776407.077129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449471872:12345-0@lo:400: 00000100:00100000:1.0:1789776407.077159:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449471872:12345-0@lo:400: Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.077165:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776407.077180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776407.077185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449472384:12345-0@lo:400: 00000100:00100000:1.0:1789776407.077211:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449472384:12345-0@lo:400: Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.077217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776407.077231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776407.077238:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449472000:12345-0@lo:400: 00000100:00100000:1.0:1789776407.077264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449472000:12345-0@lo:400: Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.077269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776407.077281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789776407.077287:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449472512:12345-0@lo:400: 00000100:00100000:1.0:1789776407.077311:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449472512:12345-0@lo:400: Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776407.077317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789776407.077344:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776407.077347:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776407.077372:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449471488:0@lo:400: 00010000:00080000:1.0:1789776407.077384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf62a00 x1876716449472000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776407.077393:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449472000:0@lo:400: 00010000:00080000:1.0:1789776407.077414:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf61880 x1876716449472512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776407.077422:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449472512:0@lo:400: 00010000:00080000:1.0:1789776407.077431:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf61f80 x1876716449471360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776407.077779:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449471360:0@lo:400: 00010000:00080000:1.0:1789776407.077796:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf62300 x1876716449471872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776407.077805:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449471872:0@lo:400: 00010000:00080000:1.0:1789776407.077815:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf63b80 x1876716449472384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776407.077823:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449472384:0@lo:400: 00000001:02000400:3.0:1789776407.568990:0:9870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789776407.970868:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789776408.388242:0:9922:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776408.388471:0:9922:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789776408.614330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449472640:0@lo:41: 00000100:00100000:1.0:1789776408.614399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776408.614638:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472640 00000100:00100000:2.0:1789776408.614646:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472640 00000100:00100000:2.0:1789776408.614702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789776408.614712:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449472640:12345-0@lo:41: 00000004:00000024:2.0:1789776408.614749:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789776408.614798:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449472640:12345-0@lo:41: Request processed in 87us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776408.614805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789776408.614847:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449472640:0@lo:41: 00000100:00100000:1.0:1789776408.617106:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449472768:0@lo:41: 00000100:00100000:1.0:1789776408.617177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776408.617226:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472768 00000100:00100000:1.0:1789776408.617232:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472768 00000100:00100000:1.0:1789776408.617268:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776408.617276:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449472768:12345-0@lo:41: 00000004:00000024:1.0:1789776408.617318:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789776408.617357:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449472768:12345-0@lo:41: Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776408.617363:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776408.617427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449472768:0@lo:41: 00010000:00010000:2.0:1789776408.996161:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776410.019726:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776410.146748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:2.0:1789776410.146773:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:1.0:1789776410.146776:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449472896:0@lo:13: 10000000:01000000:2.0:1789776410.146778:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cfc247800 from 39 10000000:01000000:2.0:1789776410.146784:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776410.146825:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.146852:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.146865:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.146882:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473024:0@lo:101: 00000100:00100000:2.0:1789776410.146938:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.146988:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776410.147000:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.147001:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449473152:0@lo:13: 00000100:00100000:3.0:1789776410.147038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.147039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473024 00000100:00100000:2.0:1789776410.147050:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473024 00000100:00100000:3.0:1789776410.147076:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473152 00000100:00100000:3.0:1789776410.147081:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473152 00000100:00100000:2.0:1789776410.147113:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789776410.147126:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776410.147127:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449473024:12345-0@lo:101: 00010000:00010000:2.0:1789776410.147143:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.147158:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8848ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789776410.147167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776410.147184:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.147196:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.147205:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ea00, rc 0) 00000100:00100000:1.0:1789776410.147228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.147253:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473024:12345-0@lo:101: Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.147261:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789776410.147322:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473024:0@lo:101: 00010000:00010000:2.0:1789776410.147342:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.147352:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776410.147370:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449473152:12345-0@lo:13: 00002000:00000024:3.0:1789776410.147395:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776410.147409:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473280:0@lo:501: 00000100:00100000:2.0:1789776410.147444:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.147461:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.147463:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449473152:12345-0@lo:13: Request processed in 96us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.147477:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473280 00000100:00100000:2.0:1789776410.147481:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473280 00000100:00100000:2.0:1789776410.147527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776410.147534:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473280:12345-0@lo:501: 00000100:00100000:2.0:1789776410.147649:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473280:12345-0@lo:501: Request processed in 115us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.147657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776410.147688:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473280:0@lo:501: 00000100:00100000:2.0:1789776410.147718:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473408:0@lo:503: 00000100:00100000:2.0:1789776410.147758:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.147789:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789776410.147825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815ea00 x1876716449473152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776410.147841:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449473152:0@lo:13: 00000100:00100000:3.0:1789776410.147857:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776410.147862:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449472896 00000100:00100000:0.0:1789776410.147868:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449472896 00000100:00100000:0.0:1789776410.147910:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776410.147917:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789776410.147919:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449472896:12345-0@lo:13: 00000100:00100000:3.0:1789776410.147925:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1789776410.147934:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776410.147979:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449472896:12345-0@lo:13: Request processed in 62us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.147986:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789776410.148011:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449472896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.148031:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449472896:0@lo:13: 00000100:00100000:1.0:1789776410.148588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473408 00000100:00100000:1.0:1789776410.148598:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473408 00000100:00100000:1.0:1789776410.148633:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789776410.148640:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473408:12345-0@lo:503: 00000100:00100000:1.0:1789776410.148761:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473408:12345-0@lo:503: Request processed in 121us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.148767:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789776410.148827:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776410.151574:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473408:0@lo:503: 00000100:00100000:3.0:1789776410.153313:0:9976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9976:1876716449473536:0@lo:502: 00000100:00100000:3.0:1789776410.153416:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.153465:0:9976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.153661:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473536 00000100:00100000:1.0:1789776410.153679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473536 00000100:00100000:1.0:1789776410.153721:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789776410.153730:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9976:x1876716449473536:12345-0@lo:502: 00000100:00100000:1.0:1789776410.153858:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9976:x1876716449473536:12345-0@lo:502: Request processed in 128us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.153865:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789776410.154237:0:9976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9976:1876716449473536:0@lo:502: 00000100:00100000:3.0:1789776410.154307:0:9976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9976:1876716449473664:0@lo:502: 00000100:00100000:3.0:1789776410.154347:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.154485:0:9976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.161952:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473664 00000100:00100000:0.0:1789776410.161970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473664 00000100:00100000:0.0:1789776410.162093:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789776410.162116:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9976:x1876716449473664:12345-0@lo:502: 00000100:00100000:0.0:1789776410.162401:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:9976:x1876716449473664:12345-0@lo:502: Request processed in 297us (8052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.162418:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789776410.167005:0:9976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9976:1876716449473664:0@lo:502: 00000040:00080000:3.0:1789776410.167062:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789776410.167330:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789776410.167366:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776410.167379:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.167739:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776410.171657:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789776410.171781:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789776410.171786:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789776410.171836:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.171849:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.171954:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776410.171995:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473792:0@lo:101: 00000100:00100000:3.0:1789776410.172072:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.172182:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.175260:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473792 00000100:00100000:0.0:1789776410.175288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473792 00000100:00100000:0.0:1789776410.175349:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789776410.175360:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449473792:12345-0@lo:101: 00010000:00010000:0.0:1789776410.175379:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776410.175412:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8848bc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.175443:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.175456:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.175465:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc0030600, rc 0) 00000100:00100000:0.0:1789776410.175575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449473792:12345-0@lo:101: Request processed in 215us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.175582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789776410.175735:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473792:0@lo:101: 00010000:00010000:3.0:1789776410.175754:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.175763:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776410.175844:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473920:0@lo:501: 00000100:00100000:3.0:1789776410.175896:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.175928:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.176760:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449473920 00000100:00100000:0.0:1789776410.176767:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449473920 00000100:00100000:0.0:1789776410.176808:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789776410.176816:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449473920:12345-0@lo:501: 00000100:00100000:0.0:1789776410.176977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449473920:12345-0@lo:501: Request processed in 161us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.176984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789776410.177147:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449473920:0@lo:501: 00000100:00100000:2.0:1789776410.177185:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474048:0@lo:503: 00000100:00100000:2.0:1789776410.177236:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.177265:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.177416:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474048 00000100:00100000:1.0:1789776410.177422:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474048 00000100:00100000:1.0:1789776410.177459:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789776410.177467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449474048:12345-0@lo:503: 00000100:00100000:1.0:1789776410.177585:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449474048:12345-0@lo:503: Request processed in 118us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.177591:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789776410.177803:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474048:0@lo:503: 00000100:00100000:0.0:1789776410.180998:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9977:1876716449474176:0@lo:502: 00000100:00100000:0.0:1789776410.181096:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.181344:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.185376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474176 00000100:00100000:1.0:1789776410.185416:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474176 00000100:00100000:1.0:1789776410.185764:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776410.185777:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9977:x1876716449474176:12345-0@lo:502: 00000100:00100000:1.0:1789776410.186392:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9977:x1876716449474176:12345-0@lo:502: Request processed in 608us (5285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.186401:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789776410.186551:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9977:1876716449474176:0@lo:502: 00000020:01000000:0.0:1789776410.186592:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776410.186602:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776410.186604:0:9977:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789776410.186608:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776410.186610:0:9977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789776410.186637:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9977:1876716449474304:0@lo:502: 00000100:00100000:0.0:1789776410.186695:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.186740:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9005d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.187021:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474304 00000100:00100000:2.0:1789776410.187027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474304 00000100:00100000:2.0:1789776410.187068:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789776410.187076:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9977:x1876716449474304:12345-0@lo:502: 00000100:00100000:2.0:1789776410.187181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:9977:x1876716449474304:12345-0@lo:502: Request processed in 106us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.187187:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789776410.187371:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9977:1876716449474304:0@lo:502: 00000020:01000000:3.0:1789776410.187394:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776410.187399:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776410.187400:0:9977:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789776410.187404:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789776410.188212:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789776410.188244:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789776410.188255:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.188279:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776410.188305:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789776410.188307:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cd0f5c800 from 39 10000000:01000000:2.0:1789776410.188310:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776410.188341:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.188349:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.188358:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.188377:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474432:0@lo:101: 00000100:00100000:2.0:1789776410.188445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.188563:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.188613:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474432 00000100:00100000:0.0:1789776410.188619:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474432 00000100:00100000:0.0:1789776410.188661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789776410.188680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449474432:12345-0@lo:101: 00010000:00010000:0.0:1789776410.188692:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776410.188704:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8848ca expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.188725:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.188735:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.188743:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc0030000, rc 0) 00000100:00100000:0.0:1789776410.188788:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449474432:12345-0@lo:101: Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.188795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789776410.189303:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474432:0@lo:101: 00010000:00010000:2.0:1789776410.189322:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.189332:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.189394:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474560:0@lo:501: 00000100:00100000:2.0:1789776410.189428:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.189474:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.189828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474560 00000100:00100000:1.0:1789776410.189835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474560 00000100:00100000:1.0:1789776410.190077:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789776410.190087:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449474560:12345-0@lo:501: 00000100:00100000:1.0:1789776410.190244:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449474560:12345-0@lo:501: Request processed in 160us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.190252:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789776410.190537:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474560:0@lo:501: 00000100:00100000:2.0:1789776410.190576:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474688:0@lo:503: 00000100:00100000:2.0:1789776410.190632:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.190656:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.190830:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474688 00000100:00100000:1.0:1789776410.190835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474688 00000100:00100000:1.0:1789776410.191025:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789776410.191033:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449474688:12345-0@lo:503: 00000100:00100000:1.0:1789776410.191131:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449474688:12345-0@lo:503: Request processed in 99us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.191139:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789776410.191209:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449474688:0@lo:503: 00000100:00100000:2.0:1789776410.191472:0:9978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9978:1876716449474816:0@lo:502: 00000100:00100000:2.0:1789776410.191535:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.200463:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474816 00000100:00100000:3.0:1789776410.200483:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474816 00000100:00100000:1.0:1789776410.211259:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789776410.211302:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:9978:x1876716449474816:12345-0@lo:502: 00000100:00100000:2.0:1789776410.212783:0:9978:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.213173:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:9978:x1876716449474816:12345-0@lo:502: Request processed in 1882us (21634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.213183:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789776410.213607:0:9978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9978:1876716449474816:0@lo:502: 00000100:00100000:2.0:1789776410.215031:0:9978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9978:1876716449474944:0@lo:502: 00000100:00100000:2.0:1789776410.215116:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.215165:0:9978:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776410.221039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449474944 00000100:00100000:1.0:1789776410.221055:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449474944 00000100:00100000:1.0:1789776410.221122:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789776410.221132:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:9978:x1876716449474944:12345-0@lo:502: 00000100:00100000:1.0:1789776410.221313:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:9978:x1876716449474944:12345-0@lo:502: Request processed in 181us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.221320:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789776410.221979:0:9978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9978:1876716449474944:0@lo:502: 00000040:00080000:2.0:1789776410.222020:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789776410.222210:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789776410.222233:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776410.222243:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.222254:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776410.222264:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776410.222277:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cd0f5c800 from 6 10000000:01000000:1.0:1789776410.222280:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776410.222314:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.222322:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.222332:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776410.222351:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475072:0@lo:101: 00000100:00100000:1.0:1789776410.222409:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.222463:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.222640:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475072 00000100:00100000:2.0:1789776410.222647:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475072 00000100:00100000:2.0:1789776410.222688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789776410.222696:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449475072:12345-0@lo:101: 00010000:00010000:2.0:1789776410.222707:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.222722:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb8848df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8848d8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.222744:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb8848df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8848d8 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.222754:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb8848df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848d8 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.222761:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217e200, rc 0) 00000100:00100000:2.0:1789776410.222805:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449475072:12345-0@lo:101: Request processed in 109us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.222811:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789776410.223114:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475072:0@lo:101: 00010000:00010000:1.0:1789776410.223137:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.223146:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776410.223197:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475200:0@lo:256: 00000100:00100000:1.0:1789776410.223228:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.223258:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.223316:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475200 00000100:00100000:2.0:1789776410.223321:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475200 00000100:00100000:2.0:1789776410.223340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789776410.223345:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449475200:12345-0@lo:256: 20000000:01000000:2.0:1789776410.223358:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776410.223374:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776410.223377:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789776410.223488:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449475200:12345-0@lo:256: Request processed in 141us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.223522:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789776410.223802:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475200:0@lo:256: 10000000:01000000:1.0:1789776410.223875:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776410.223883:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.223891:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776410.223899:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789776410.223901:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789776410.223903:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789776410.223924:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.223932:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.223941:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776410.223964:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475328:0@lo:101: 00000100:00100000:1.0:1789776410.223997:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.224026:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.224129:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475328 00000100:00100000:2.0:1789776410.224134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475328 00000100:00100000:2.0:1789776410.224156:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789776410.224162:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449475328:12345-0@lo:101: 00010000:00010000:2.0:1789776410.224171:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.224183:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8848e6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.224202:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.224209:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.224216:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ee00, rc 0) 00000100:00100000:2.0:1789776410.224253:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449475328:12345-0@lo:101: Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.224264:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789776410.224969:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475328:0@lo:101: 00010000:00010000:1.0:1789776410.224984:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.224992:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776410.225046:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475456:0@lo:501: 00000100:00100000:1.0:1789776410.225074:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.225103:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.225148:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475456 00000100:00100000:2.0:1789776410.225152:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475456 00000100:00100000:2.0:1789776410.225183:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789776410.225190:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449475456:12345-0@lo:501: 00000100:00100000:2.0:1789776410.225324:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449475456:12345-0@lo:501: Request processed in 133us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.225331:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789776410.225619:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475456:0@lo:501: 00000100:00100000:1.0:1789776410.225644:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475584:0@lo:503: 00000100:00100000:1.0:1789776410.225748:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.225947:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.229687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475584 00000100:00100000:3.0:1789776410.229704:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475584 00000100:00100000:3.0:1789776410.229769:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789776410.229780:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449475584:12345-0@lo:503: 00000100:00100000:3.0:1789776410.232219:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449475584:12345-0@lo:503: Request processed in 2431us (6460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.232250:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789776410.232406:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449475584:0@lo:503: 00000100:00100000:1.0:1789776410.233199:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9979:1876716449475712:0@lo:502: 00000100:00100000:1.0:1789776410.233249:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.233312:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.234105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475712 00000100:00100000:3.0:1789776410.234122:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475712 00000100:00100000:3.0:1789776410.234179:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789776410.234189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:9979:x1876716449475712:12345-0@lo:502: 00000100:00100000:3.0:1789776410.234346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:9979:x1876716449475712:12345-0@lo:502: Request processed in 158us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.234352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789776410.234410:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9979:1876716449475712:0@lo:502: 00000020:01000000:3.0:1789776410.235012:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789776410.235023:0:9979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789776410.235031:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776410.235033:0:9979:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789776410.235041:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789776410.235045:0:9979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1789776410.235069:0:9979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789776410.235072:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776410.235088:0:9979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a5cff3b19b8) 00000020:00000080:3.0:1789776410.235347:0:9979:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789776410.235356:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789776410.235450:0:9979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789776410.235465:0:9979:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789776410.235472:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb8848fb 00010000:00080000:3.0:1789776410.235520:0:9979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cfc2ef000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1789776410.235833:0:9979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789776410.236133:0:9979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789776410.236146:0:9979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789776410.236328:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776410.236450:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776410.236651:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789776410.238370:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789776410.243173:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776410.243185:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789776410.245344:0:9979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789776410.245364:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789776410.245407:0:9979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789776410.245430:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb884902 00000100:00080000:1.0:1789776410.245450:0:9979:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776410.245456:0:9979:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cfc2ef000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776410.245488:0:9979:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cedf60380 x1876716449475840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776410.245590:0:9979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789776410.245701:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776410.245705:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776410.245707:0:9979:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789776410.245710:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776410.245713:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776410.245715:0:9979:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776410.245718:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776410.245719:0:9979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789776410.245745:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9979:1876716449475968:0@lo:502: 00000100:00100000:1.0:1789776410.245828:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.245877:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.246041:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449475840:0@lo:8: 00000100:00100000:2.0:1789776410.246078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.246212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475968 00000100:00100000:3.0:1789776410.246220:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475968 00000100:00100000:3.0:1789776410.246279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789776410.246289:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:9979:x1876716449475968:12345-0@lo:502: 00000100:00100000:3.0:1789776410.246416:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:9979:x1876716449475968:12345-0@lo:502: Request processed in 128us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.246424:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789776410.246517:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9979:1876716449475968:0@lo:502: 00000020:01000000:3.0:1789776410.246544:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776410.246549:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776410.246550:0:9979:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789776410.246554:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789776410.246607:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789776410.246627:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789776410.246637:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.246648:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776410.246670:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776410.246673:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cdb443800 from 39 10000000:01000000:3.0:1789776410.246677:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776410.246701:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.246708:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776410.246726:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776410.246739:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476096:0@lo:101: 00000100:00100000:3.0:1789776410.246772:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.246787:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d13480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.247246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476096 00000100:00100000:2.0:1789776410.247253:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476096 00000100:00100000:2.0:1789776410.247300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789776410.247308:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449476096:12345-0@lo:101: 00010000:00010000:2.0:1789776410.247318:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.247344:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884909 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.247369:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884909 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.247391:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884909 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.247399:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342cc00, rc 0) 00000100:00100000:2.0:1789776410.247449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449476096:12345-0@lo:101: Request processed in 142us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.247463:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789776410.247522:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476096:0@lo:101: 00010000:00010000:2.0:1789776410.247535:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.247544:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.247602:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476224:0@lo:501: 00000100:00100000:2.0:1789776410.247628:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.247650:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.247674:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476224 00000100:00100000:2.0:1789776410.247678:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476224 00000100:00100000:2.0:1789776410.247695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789776410.247702:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449476224:12345-0@lo:501: 00000100:00100000:2.0:1789776410.247807:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449476224:12345-0@lo:501: Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.247814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789776410.247841:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476224:0@lo:501: 00000100:00100000:2.0:1789776410.247881:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476352:0@lo:503: 00000100:00100000:2.0:1789776410.247916:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.247928:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.247939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476352 00000100:00100000:2.0:1789776410.247943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476352 00000100:00100000:2.0:1789776410.247961:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776410.247965:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449476352:12345-0@lo:503: 00000100:00100000:2.0:1789776410.248045:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449476352:12345-0@lo:503: Request processed in 79us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.248052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776410.248087:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449476352:0@lo:503: 00000100:00100000:1.0:1789776410.248473:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449475840 00000100:00100000:1.0:1789776410.248479:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449475840 00000100:00100000:1.0:1789776410.248543:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776410.248549:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876716449475840:12345-0@lo:8: 00010000:00080000:1.0:1789776410.248574:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:1.0:1789776410.248604:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb884917 00002000:00100000:1.0:1789776410.248618:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a5bc252b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789776410.248622:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789776410.248626:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789776410.248700:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789776410.248963:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789776410.248987:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5bc252c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776410.249038:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449475840:12345-0@lo:8: Request processed in 487us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.249045:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789776410.249456:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf60380 x1876716449475840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776410.249469:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776410.249476:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789776410.249484:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776410.249515:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789776410.249518:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2ef000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776410.249531:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776410.249536:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449475840:0@lo:8: 00000100:00100000:3.0:1789776410.249777:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449476480:0@lo:700: 00000100:00100000:3.0:1789776410.249824:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.249870:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d13480 going to sleep for 11 seconds 00000004:00080000:1.0:1789776410.253342:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789776410.253465:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 231497971022ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789776410.253474:0:9980:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789776410.253560:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476480 00000100:00100000:2.0:1789776410.253570:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476480 00000100:00100000:2.0:1789776410.253645:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776410.253655:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9981:x1876716449476480:12345-0@lo:700: 00000100:00100000:2.0:1789776410.253726:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1876716449476608:0@lo:700: 00000100:00100000:2.0:1789776410.253794:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.253824:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.253850:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476608 00000100:00100000:2.0:1789776410.253866:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476608 00000100:00100000:2.0:1789776410.253899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776410.253907:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1876716449476608:12345-0@lo:700: 00000100:00080000:3.0:1789776410.255294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776410.255302:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776410.258737:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9982:1876716449476736:0@lo:502: 00000100:00100000:3.0:1789776410.258833:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.258899:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74eca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.259069:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476736 00000100:00100000:2.0:1789776410.259083:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476736 00000100:00100000:2.0:1789776410.259142:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789776410.259152:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:9982:x1876716449476736:12345-0@lo:502: 00000100:00100000:2.0:1789776410.259297:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:9982:x1876716449476736:12345-0@lo:502: Request processed in 146us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.259304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789776410.259610:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449476864:0@lo:400: 00000100:00100000:0.0:1789776410.259646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.259700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476864 00000100:00100000:0.0:1789776410.259704:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476864 00000100:00100000:0.0:1789776410.259734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776410.259740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449476864:12345-0@lo:400: 00000100:00100000:0.0:1789776410.259777:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449476864:12345-0@lo:400: Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.259784:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789776410.259818:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815e680 x1876716449476864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.259833:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449476864:0@lo:400: 00000100:00100000:0.0:1789776410.259972:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449476992:0@lo:400: 00000100:00100000:0.0:1789776410.260002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.260033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449476992 00000100:00100000:0.0:1789776410.260037:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449476992 00000100:00100000:0.0:1789776410.260061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776410.260067:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449476992:12345-0@lo:400: 00000100:00100000:0.0:1789776410.260104:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449476992:12345-0@lo:400: Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.260120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776410.260148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449476992:0@lo:400: 00000100:00100000:0.0:1789776410.260184:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449477120:0@lo:400: 00000100:00100000:0.0:1789776410.260209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.260240:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477120 00000100:00100000:0.0:1789776410.260244:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477120 00000100:00100000:0.0:1789776410.260285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776410.260290:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449477120:12345-0@lo:400: 00000100:00100000:0.0:1789776410.260323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449477120:12345-0@lo:400: Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.260328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789776410.260355:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815e680 x1876716449477120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.260365:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449477120:0@lo:400: 00000100:00100000:3.0:1789776410.260978:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9982:1876716449476736:0@lo:502: 00000100:00100000:3.0:1789776410.261037:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9982:1876716449477376:0@lo:502: 00000100:00100000:3.0:1789776410.261081:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.261115:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477376 00000100:00100000:3.0:1789776410.261119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477376 00000100:00100000:3.0:1789776410.261148:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789776410.261155:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:9982:x1876716449477376:12345-0@lo:502: 00000100:00100000:3.0:1789776410.261254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:9982:x1876716449477376:12345-0@lo:502: Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.261261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789776410.261314:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74eca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.261332:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9982:1876716449477376:0@lo:502: 00000040:00080000:3.0:1789776410.261351:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789776410.261962:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789776410.261985:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776410.262001:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262012:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776410.262022:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789776410.262024:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5cdb443800 from 6 10000000:01000000:2.0:1789776410.262027:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789776410.262054:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262061:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262070:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.262086:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477504:0@lo:101: 00000100:00100000:2.0:1789776410.262134:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.262159:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.262175:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477504 00000100:00100000:2.0:1789776410.262186:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477504 00000100:00100000:2.0:1789776410.262221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789776410.262228:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449477504:12345-0@lo:101: 00010000:00010000:2.0:1789776410.262238:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.262250:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342dc00/0xf13b8042cb884925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88491e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262280:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342dc00/0xf13b8042cb884925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88491e expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262290:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342dc00/0xf13b8042cb884925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88491e expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262299:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342dc00, rc 0) 00000100:00100000:2.0:1789776410.262330:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449477504:12345-0@lo:101: Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.262337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789776410.262372:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477504:0@lo:101: 00010000:00010000:2.0:1789776410.262384:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262405:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.262453:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477632:0@lo:256: 00000100:00100000:2.0:1789776410.262482:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.262521:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.262532:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477632 00000100:00100000:2.0:1789776410.262535:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477632 00000100:00100000:2.0:1789776410.262563:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789776410.262570:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449477632:12345-0@lo:256: 20000000:01000000:2.0:1789776410.262582:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776410.262597:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776410.262600:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789776410.262688:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449477632:12345-0@lo:256: Request processed in 118us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.262695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789776410.262725:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477632:0@lo:256: 10000000:01000000:2.0:1789776410.262773:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789776410.262779:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262786:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776410.262793:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789776410.262795:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789776410.262798:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776410.262814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262820:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262827:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.262838:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477760:0@lo:101: 00000100:00100000:2.0:1789776410.262870:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.262884:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.262896:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477760 00000100:00100000:2.0:1789776410.262899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477760 00000100:00100000:2.0:1789776410.262918:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789776410.262923:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449477760:12345-0@lo:101: 00010000:00010000:2.0:1789776410.262930:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.262939:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb88492c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262952:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262960:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.262966:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d200, rc 0) 00000100:00100000:2.0:1789776410.262997:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449477760:12345-0@lo:101: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.263003:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789776410.263037:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477760:0@lo:101: 00010000:00010000:2.0:1789776410.263047:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.263054:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776410.263109:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477888:0@lo:501: 00000100:00100000:2.0:1789776410.263144:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.263169:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.263184:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477888 00000100:00100000:2.0:1789776410.263187:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477888 00000100:00100000:2.0:1789776410.263210:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789776410.263216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449477888:12345-0@lo:501: 00000100:00100000:2.0:1789776410.263328:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449477888:12345-0@lo:501: Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.263335:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789776410.263364:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449477888:0@lo:501: 00000100:00100000:2.0:1789776410.263389:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449478016:0@lo:503: 00000100:00100000:2.0:1789776410.263426:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.263439:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.263450:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478016 00000100:00100000:2.0:1789776410.263453:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478016 00000100:00100000:2.0:1789776410.263473:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789776410.263479:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449478016:12345-0@lo:503: 00000100:00100000:2.0:1789776410.263577:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449478016:12345-0@lo:503: Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.263583:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789776410.263623:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449478016:0@lo:503: 00000100:00100000:0.0:1789776410.264245:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776410.264263:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449477248:0@lo:400: 00000100:00100000:0.0:1789776410.264330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.264372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449477248 00000100:00100000:0.0:1789776410.264377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449477248 00000100:00100000:0.0:1789776410.264411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776410.264418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449477248:12345-0@lo:400: 00000100:00100000:0.0:1789776410.264464:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449477248:12345-0@lo:400: Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.264472:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776410.265029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449477248:0@lo:400: 00000100:00100000:0.0:1789776410.265086:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449478144:0@lo:400: 00000100:00100000:0.0:1789776410.265117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.265148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478144 00000100:00100000:0.0:1789776410.265152:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478144 00000100:00100000:0.0:1789776410.265194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776410.265240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449478144:12345-0@lo:400: 00000100:00100000:0.0:1789776410.265293:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449478144:12345-0@lo:400: Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.265307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789776410.265387:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776410.265410:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ea00 x1876716449478144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.265420:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449478144:0@lo:400: 00000100:00100000:0.0:1789776410.265450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449478272:0@lo:400: 00000100:00100000:0.0:1789776410.265475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.265605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478272 00000100:00100000:0.0:1789776410.265619:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478272 00000100:00100000:0.0:1789776410.265654:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789776410.265660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449478272:12345-0@lo:400: 00000100:00100000:0.0:1789776410.265691:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449478272:12345-0@lo:400: Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.265697:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789776410.265718:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ea00 x1876716449478272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.265727:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449478272:0@lo:400: 00000100:00100000:0.0:1789776410.265768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449478400:0@lo:400: 00000100:00100000:0.0:1789776410.265794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.265815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478400 00000100:00100000:0.0:1789776410.265819:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478400 00000100:00100000:0.0:1789776410.265839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776410.265844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449478400:12345-0@lo:400: 00000100:00100000:0.0:1789776410.265885:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449478400:12345-0@lo:400: Request processed in 40us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.265900:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789776410.265924:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ea00 x1876716449478400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.265932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449478400:0@lo:400: 00000100:00080000:1.0:1789776410.266487:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789776410.268049:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789776410.275071:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9983:1876716449478528:0@lo:502: 00000100:00100000:3.0:1789776410.275182:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.275229:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.275283:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478528 00000100:00100000:2.0:1789776410.275292:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478528 00000100:00100000:2.0:1789776410.275356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789776410.275367:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:9983:x1876716449478528:12345-0@lo:502: 00000100:00100000:2.0:1789776410.275526:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:9983:x1876716449478528:12345-0@lo:502: Request processed in 161us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.275540:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789776410.276353:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9983:1876716449478528:0@lo:502: 00000020:01000000:3.0:1789776410.276409:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789776410.276418:0:9983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789776410.276427:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776410.276430:0:9983:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789776410.276435:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789776410.276439:0:9983:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1789776410.276466:0:9983:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789776410.276470:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776410.276513:0:9983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a5cff3b3370) 00000020:00000080:3.0:1789776410.276537:0:9983:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789776410.276543:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789776410.276648:0:9983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789776410.276654:0:9983:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789776410.276661:0:9983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb884941 00010000:00080000:3.0:1789776410.276691:0:9983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc3451800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 40000000:02000000:2.0:1789776410.276783:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00010000:3.0:1789776410.276952:0:9983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789776410.277085:0:9983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789776410.277099:0:9983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789776410.277295:0:9983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776410.277446:0:9983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776410.282280:0:9983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000100:00100000:2.0:1789776410.282420:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1876716449476608:12345-0@lo:700: Request processed in 28507us (28619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.282446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789776410.284414:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e09c00 x1876716449476608/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776410.284525:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1876716449476608:0@lo:700: 40000000:02000000:1.0:1789776410.284543:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:3.0:1789776410.287665:0:9983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:0.0:1789776410.291603:0:9983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776410.291618:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789776410.291657:0:9983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789776410.293551:0:9983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb884948 00000100:00080000:0.0:1789776410.293562:0:9983:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776410.293568:0:9983:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5bc3451800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776410.293608:0:9983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cf5e2ea00 x1876716449478656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776410.293629:0:9983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000040:00080000:3.0:1789776410.293659:0:9984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776410.293665:0:9984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:01000000:0.0:1789776410.293734:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776410.293740:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776410.293741:0:9983:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789776410.293744:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776410.293748:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776410.293749:0:9983:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789776410.293751:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776410.293753:0:9983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789776410.293805:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9983:1876716449478784:0@lo:502: 00000100:00100000:0.0:1789776410.293991:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.294040:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.295259:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449478656:0@lo:8: 00000100:00100000:2.0:1789776410.295340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776410.295685:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478656 00000100:00100000:0.0:1789776410.295693:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478656 00000100:00100000:0.0:1789776410.295731:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789776410.295739:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449478656:12345-0@lo:8: 00010000:00080000:0.0:1789776410.295785:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1789776410.295818:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb88494f 00002000:00100000:0.0:1789776410.295835:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a5bc31aa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789776410.295840:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789776410.295843:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789776410.296011:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789776410.296036:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5bc31ac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776410.296090:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449478656:12345-0@lo:8: Request processed in 350us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.296097:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776410.296245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478784 00000100:00100000:3.0:1789776410.296250:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478784 00010000:00080000:2.0:1789776410.296289:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ea00 x1876716449478656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.296300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789776410.296301:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776410.296310:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1789776410.296312:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:9983:x1876716449478784:12345-0@lo:502: 00000100:00080000:2.0:1789776410.296319:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776410.296327:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789776410.296329:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3451800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776410.296344:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776410.296350:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449478656:0@lo:8: 00000100:00100000:3.0:1789776410.296432:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:9983:x1876716449478784:12345-0@lo:502: Request processed in 122us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.296439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000004:00080000:3.0:1789776410.296477:0:9984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789776410.299235:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:9983:1876716449478784:0@lo:502: 00000020:01000000:0.0:1789776410.299292:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776410.299300:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776410.299302:0:9983:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789776410.299307:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:2.0:1789776410.299890:0:9984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 231544395386ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789776410.299914:0:9984:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1789776410.300826:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789776410.300857:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789776410.300868:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.300882:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776410.300893:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789776410.300895:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5cc8c63370 from 1 10000000:01000000:1.0:1789776410.300898:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789776410.300937:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.300944:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.300964:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776410.300989:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449478912:0@lo:101: 00000100:00100000:1.0:1789776410.301062:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.303121:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449478912 00000100:00100000:2.0:1789776410.303134:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449478912 00000100:00100000:2.0:1789776410.303189:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789776410.303201:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449478912:12345-0@lo:101: 00010000:00010000:2.0:1789776410.303216:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776410.303235:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884956 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.303289:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884956 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.303301:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884956 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776410.303320:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000004:00080000:0.0:1789776410.303421:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1789776410.303645:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789776410.303651:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789776410.303744:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449476480:12345-0@lo:700: Request processed in 50090us (53918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776410.303758:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789776410.303841:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e680 x1876716449476480/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.303857:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449476480:0@lo:700: 00000100:00100000:1.0:1789776410.304046:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.304112:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449478912:12345-0@lo:101: Request processed in 913us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.304120:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789776410.304200:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449478912:0@lo:101: 00000004:00080000:2.0:1789776410.304201:0:9985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00010000:00010000:1.0:1789776410.304218:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776410.304231:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776410.304303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776410.304317:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449479040:0@lo:13: 00000100:00100000:3.0:1789776410.304361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.304371:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479168:0@lo:7: 00000100:00100000:2.0:1789776410.304405:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.304432:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.304453:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479168 00000100:00100000:3.0:1789776410.304459:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479168 00000100:00100000:3.0:1789776410.304621:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776410.304631:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9985:x1876716449479168:12345-0@lo:7: 00000100:00100000:0.0:1789776410.305301:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479040 00000100:00100000:0.0:1789776410.305308:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479040 00000100:00100000:0.0:1789776410.305345:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776410.305353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449479040:12345-0@lo:13: 00002000:00000024:0.0:1789776410.305371:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:0.0:1789776410.305425:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449479040:12345-0@lo:13: Request processed in 72us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776410.305859:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449479296:0@lo:501: 00000100:00100000:1.0:1789776410.305901:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776410.307796:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3540240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.307848:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479296 00000100:00100000:2.0:1789776410.307858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479296 00000100:00100000:0.0:1789776410.307904:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776410.307908:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789776410.307940:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449479296:12345-0@lo:501: 00010000:00080000:0.0:1789776410.307982:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0b100 x1876716449479040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776410.308009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449479040:0@lo:13: 00000100:00100000:2.0:1789776410.308056:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449479296:12345-0@lo:501: Request processed in 138us (2153us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776410.308064:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789776410.308075:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449479296:0@lo:501: 10000000:01000000:0.0:1789776410.308282:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789776410.308292:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776410.308303:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789776410.308607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789776410.311859:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789776410.311867:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789776410.311959:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9985:x1876716449479168:12345-0@lo:7: Request processed in 7326us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.311969:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789776410.312007:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0b480 x1876716449479168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.312022:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479168:0@lo:7: 00000004:00080000:3.0:1789776410.312036:0:9985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789776410.312075:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479424:0@lo:5: 00000100:00100000:3.0:1789776410.312335:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.312375:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6f00 going to sleep for 11 seconds 00000004:00080000:3.0:1789776410.314780:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789776410.314807:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449479680:0@lo:7: 00000100:00100000:3.0:1789776410.314862:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.314885:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d13480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.315009:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449479552:0@lo:13: 00000100:00100000:0.0:1789776410.315041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.315525:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479552 00000100:00100000:3.0:1789776410.315534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479552 00000100:00100000:3.0:1789776410.315646:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776410.315654:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449479552:12345-0@lo:13: 00002000:00000024:3.0:1789776410.315793:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1789776410.315844:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449479552:12345-0@lo:13: Request processed in 190us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776410.315851:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776410.315959:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479424 00000100:00100000:2.0:1789776410.315977:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479424 00000100:00100000:2.0:1789776410.316133:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479680 00000100:00100000:2.0:1789776410.316137:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479680 00000100:00100000:2.0:1789776410.316160:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776410.316166:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9985:x1876716449479424:12345-0@lo:5: 00002000:00080000:2.0:1789776410.316185:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789776410.316189:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789776410.316226:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776410.316237:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449479680:12345-0@lo:7: 00010000:00080000:1.0:1789776410.316345:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35f480 x1876716449479552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776410.316367:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449479552:0@lo:13: 00002000:00080000:2.0:1789776410.323803:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789776410.323811:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789776410.323912:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449479680:12345-0@lo:7: Request processed in 7672us (9044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.323924:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776410.324365:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9985:x1876716449479424:12345-0@lo:5: Request processed in 8198us (12255us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789776410.324371:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789776410.324571:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35c380 x1876716449479424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776410.324590:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479424:0@lo:5: 00000004:00080000:2.0:1789776410.324604:0:9985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789776410.324644:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479808:0@lo:700: 00000100:00100000:2.0:1789776410.324686:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.324706:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd05e6f00 going to sleep for 11 seconds 00010000:00080000:3.0:1789776410.324827:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449479680/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.324839:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449479680:0@lo:7: 00000004:00080000:3.0:1789776410.324848:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789776410.324871:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449479936:0@lo:5: 00000100:00100000:3.0:1789776410.324899:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.324924:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2cb70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776410.324986:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479808 00000100:00100000:0.0:1789776410.324992:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479808 00000100:00100000:0.0:1789776410.325041:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776410.325050:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9985:x1876716449479808:12345-0@lo:700: 00000100:00100000:2.0:1789776410.325804:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449479936 00000100:00100000:2.0:1789776410.325812:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449479936 00000100:00100000:2.0:1789776410.325846:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776410.325853:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449479936:12345-0@lo:5: 00002000:00080000:2.0:1789776410.325874:0:8528:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789776410.325918:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449479936:12345-0@lo:5: Request processed in 66us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.325925:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789776410.326154:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449479936/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.326166:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449479936:0@lo:5: 00000004:00080000:3.0:1789776410.326176:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789776410.326216:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449480064:0@lo:5: 00000100:00100000:3.0:1789776410.326245:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.326279:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2cb70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.326383:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480064 00000100:00100000:2.0:1789776410.326394:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480064 00000100:00100000:2.0:1789776410.326429:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776410.326736:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9981:x1876716449480064:12345-0@lo:5: 00002000:00080000:2.0:1789776410.326768:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789776410.339378:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9981:x1876716449480064:12345-0@lo:5: Request processed in 12639us (13123us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789776410.339391:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789776410.339471:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449480064/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776410.339485:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1876716449480064:0@lo:5: 00000004:00080000:3.0:1789776410.339520:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789776410.339564:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9981:1876716449480192:0@lo:900: 00000100:00100000:3.0:1789776410.339614:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776410.339640:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2cb70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776410.339649:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480192 00000100:00100000:2.0:1789776410.339656:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480192 00000100:00100000:2.0:1789776410.339703:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776410.339712:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9981:x1876716449480192:12345-0@lo:900: 00000100:00100000:2.0:1789776410.339910:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9981:x1876716449480192:12345-0@lo:900: Request processed in 199us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.340030:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:0.0:1789776410.340088:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:1.0:1789776410.340851:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35fb80 x1876716449480192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776410.340864:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9981:1876716449480192:0@lo:900: 00000100:00100000:2.0:1789776410.341038:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9985:x1876716449479808:12345-0@lo:700: Request processed in 15988us (16349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776410.341048:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789776410.341102:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0ad80 x1876716449479808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776410.341112:0:9985:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789776410.341124:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449479808:0@lo:700: 00000004:02000040:3.0:1789776410.345079:0:9985:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000001:00080000:0.0:1789776410.350489:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789776410.358713:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449480320:0@lo:5: 00000100:00100000:2.0:1789776410.358783:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776410.358816:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776410.359003:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480320 00000100:00100000:3.0:1789776410.359011:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480320 00000100:00100000:3.0:1789776410.359066:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776410.359077:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9985:x1876716449480320:12345-0@lo:5: 00002000:00080000:3.0:1789776410.366903:0:8528:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789776410.366924:0:8528:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789776410.368462:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9985:x1876716449480320:12345-0@lo:5: Request processed in 9381us (9672us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789776410.368474:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789776410.368888:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0ad80 x1876716449480320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776410.368906:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1876716449480320:0@lo:5: 00000004:00080000:2.0:1789776410.368927:0:9985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1789776411.043652:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789776411.315374:0:10035:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776411.315912:0:10035:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776412.067746:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789776412.140364:0:10083:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776412.140374:0:10083:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789776412.774987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.775304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432654464 00000100:00100000:2.0:1789776412.775318:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432654464 00000100:00100000:2.0:1789776412.775378:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:2.0:1789776412.775399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2410:x1876716432654464:12345-192.168.204.27@tcp:250: 00010000:00080000:2.0:1789776412.775436:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 26d07c66-77a6-40e8-834e-e7f05c9f1ea4@192.168.204.27@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1789776412.775475:0:6511:0:(genops.c:1385:class_connect()) connect: client 26d07c66-77a6-40e8-834e-e7f05c9f1ea4, cookie 0xf13b8042cb884964 00000100:00080000:2.0:1789776412.775688:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776412.775792:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+5:2410:x1876716432654464:12345-192.168.204.27@tcp:250: Request processed in 393us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.775800:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:1.0:1789776412.783607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776412.783714:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432654592 00000100:00100000:3.0:1789776412.783733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432654592 00000100:00100000:3.0:1789776412.783815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:3.0:1789776412.783826:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+5:6167:x1876716432654592:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1789776412.783867:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776412.783891:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5607 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.783927:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.783939:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.783950:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256e00, rc 0) 00000100:00100000:3.0:1789776412.784029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+6:6167:x1876716432654592:12345-192.168.204.27@tcp:101: Request processed in 205us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776412.784036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:1.0:1789776412.789374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776412.789488:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432654720 00000100:00100000:0.0:1789776412.789532:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432654720 00000100:00100000:0.0:1789776412.789593:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:0.0:1789776412.789603:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+6:6167:x1876716432654720:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1789776412.789740:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+6:6167:x1876716432654720:12345-192.168.204.27@tcp:501: Request processed in 137us (378us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776412.789750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:1.0:1789776412.803449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.803594:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432654848 00000100:00100000:2.0:1789776412.803604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432654848 00000100:00100000:2.0:1789776412.803659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1789776412.803670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+6:6167:x1876716432654848:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1789776412.803686:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776412.803704:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab560e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.803731:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.803742:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.803752:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342da00, rc 0) 00000100:00100000:2.0:1789776412.803822:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+7:6167:x1876716432654848:12345-192.168.204.27@tcp:101: Request processed in 154us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.803830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:1.0:1789776412.806267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776412.806363:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432654976 00000100:00100000:0.0:1789776412.806373:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432654976 00000100:00100000:0.0:1789776412.806444:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:0.0:1789776412.806455:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+7:6167:x1876716432654976:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1789776412.806649:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6167:x1876716432654976:12345-192.168.204.27@tcp:501: Request processed in 194us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776412.806657:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:0.0:1789776412.810018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776412.811398:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655104 00000100:00100000:1.0:1789776412.811411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655104 00000100:00100000:1.0:1789776412.811483:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:1.0:1789776412.811508:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6167:x1876716432655104:12345-192.168.204.27@tcp:503: 00000100:00100000:1.0:1789776412.811684:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6167:x1876716432655104:12345-192.168.204.27@tcp:503: Request processed in 192us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776412.811692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:1.0:1789776412.816721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.816888:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655232 00000100:00100000:2.0:1789776412.816898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655232 00000100:00100000:2.0:1789776412.816992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:2.0:1789776412.817003:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6186:x1876716432655232:12345-192.168.204.27@tcp:502: 00000100:00100000:2.0:1789776412.817161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6186:x1876716432655232:12345-192.168.204.27@tcp:502: Request processed in 159us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.817170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1789776412.877002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776412.877280:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655360 00000100:00100000:1.0:1789776412.877291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655360 00000100:00100000:1.0:1789776412.877353:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1789776412.877363:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6186:x1876716432655360:12345-192.168.204.27@tcp:502: 00000100:00100000:1.0:1789776412.877555:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6186:x1876716432655360:12345-192.168.204.27@tcp:502: Request processed in 192us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776412.877562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1789776412.889063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.889242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655488 00000100:00100000:2.0:1789776412.889251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655488 00000100:00100000:2.0:1789776412.889308:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:2.0:1789776412.889328:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6167:x1876716432655488:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1789776412.889346:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776412.889366:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342d000/0xf13b8042cb884979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab563f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.889395:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342d000/0xf13b8042cb884979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab563f expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.889408:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342d000/0xf13b8042cb884979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab563f expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776412.889418:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d000, rc 0) 00000100:00100000:2.0:1789776412.889481:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6167:x1876716432655488:12345-192.168.204.27@tcp:101: Request processed in 156us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.889489:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:2.0:1789776412.899956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776412.900049:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655616 00000100:00100000:0.0:1789776412.900059:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655616 00000100:00100000:0.0:1789776412.900110:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1789776412.900119:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6167:x1876716432655616:12345-192.168.204.27@tcp:256: 20000000:01000000:0.0:1789776412.900144:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789776412.900166:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789776412.900170:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789776412.900174:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789776412.900177:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789776412.900180:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789776412.906415:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6167:x1876716432655616:12345-192.168.204.27@tcp:256: Request processed in 6286us (6458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776412.906439:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:1.0:1789776412.919254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776412.919340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655744 00000100:00100000:3.0:1789776412.919349:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655744 00000100:00100000:3.0:1789776412.919411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:3.0:1789776412.919421:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6167:x1876716432655744:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1789776412.919438:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776412.919453:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5646 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.919480:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.919518:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776412.919543:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257800, rc 0) 00000100:00100000:3.0:1789776412.919599:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6167:x1876716432655744:12345-192.168.204.27@tcp:101: Request processed in 179us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776412.919606:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:2.0:1789776412.925141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776412.925349:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432655872 00000100:00100000:0.0:1789776412.925357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432655872 00000100:00100000:0.0:1789776412.925410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:0.0:1789776412.925417:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6167:x1876716432655872:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1789776412.925597:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6167:x1876716432655872:12345-192.168.204.27@tcp:501: Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776412.925604:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:1.0:1789776412.929655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.929779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656000 00000100:00100000:2.0:1789776412.929791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656000 00000100:00100000:2.0:1789776412.929856:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:2.0:1789776412.929867:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6167:x1876716432656000:12345-192.168.204.27@tcp:503: 00000100:00100000:2.0:1789776412.930077:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6167:x1876716432656000:12345-192.168.204.27@tcp:503: Request processed in 211us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.930085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:1.0:1789776412.932465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776412.932590:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656128 00000100:00100000:3.0:1789776412.932599:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656128 00000100:00100000:3.0:1789776412.932652:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1789776412.932661:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6189:x1876716432656128:12345-192.168.204.27@tcp:502: 00000100:00100000:3.0:1789776412.932799:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6189:x1876716432656128:12345-192.168.204.27@tcp:502: Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776412.932808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:1.0:1789776412.942808:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.942993:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656256 00000100:00100000:2.0:1789776412.943005:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656256 00000100:00100000:2.0:1789776412.943068:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:2.0:1789776412.943079:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6189:x1876716432656256:12345-192.168.204.27@tcp:502: 00000100:00100000:2.0:1789776412.943251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6189:x1876716432656256:12345-192.168.204.27@tcp:502: Request processed in 173us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.943259:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:1.0:1789776412.951911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776412.953777:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656384 00000100:00100000:0.0:1789776412.953790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656384 00000100:00100000:0.0:1789776412.953854:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1789776412.953875:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1876716432656384:12345-192.168.204.27@tcp:38: 00010000:00080000:0.0:1789776412.953905:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:0.0:1789776412.953956:0:6516:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb884987 00000004:00100000:0.0:1789776412.953980:0:6516:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789776412.955204:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8a5bc31a8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776412.955317:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432656384:12345-192.168.204.27@tcp:38: Request processed in 1438us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776412.955328:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1789776412.955762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776412.956090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656640 00000100:00100000:2.0:1789776412.956099:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656640 00000100:00100000:2.0:1789776412.956149:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1789776412.956157:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2410:x1876716432656640:12345-192.168.204.27@tcp:38: 00010000:00080000:2.0:1789776412.956184:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1789776412.956245:0:6517:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb88498e 00000004:00100000:2.0:1789776412.956268:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789776412.956533:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc241000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776412.956591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432656640:12345-192.168.204.27@tcp:38: Request processed in 432us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776412.956608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00010000:00010000:3.0:1789776413.090932:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776413.730767:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449480576:0@lo:41: 00000100:00100000:0.0:1789776413.730835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776413.731023:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480576 00000100:00100000:2.0:1789776413.731032:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480576 00000100:00100000:2.0:1789776413.731086:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776413.731097:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449480576:12345-0@lo:41: 00000004:00000024:2.0:1789776413.731130:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789776413.731185:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449480576:12345-0@lo:41: Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.731194:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776413.731215:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776413.731229:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449480448:0@lo:41: 00000100:00100000:1.0:1789776413.731264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.731317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449480576:0@lo:41: 00000100:00100000:2.0:1789776413.731397:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480448 00000100:00100000:2.0:1789776413.731401:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480448 00000100:00100000:2.0:1789776413.731436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776413.731443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449480448:12345-0@lo:41: 00000004:00000024:2.0:1789776413.731462:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776413.731964:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449480448:12345-0@lo:41: Request processed in 521us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.731972:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789776413.732040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449480448:0@lo:41: 00000100:00100000:2.0:1789776413.960881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776413.960925:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776413.960957:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656768 00000100:00100000:0.0:1789776413.960968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656768 00000100:00100000:2.0:1789776413.960992:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776413.961017:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656896 00000100:00100000:2.0:1789776413.961022:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656896 00000100:00100000:0.0:1789776413.961034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432656512 00000100:00100000:0.0:1789776413.961040:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432656512 00000100:00100000:2.0:1789776413.961058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1789776413.961078:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432656768:12345-192.168.204.27@tcp:41: 00000100:00080000:0.0:1789776413.961085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776413.961097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1789776413.961119:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776413.961204:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432656768:12345-192.168.204.27@tcp:41: Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.961219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1789776413.961239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1789776413.961245:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:6167:x1876716432656896:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1789776413.961263:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789776413.961289:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:6167:x1876716432656896:12345-192.168.204.27@tcp:41: Request processed in 44us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.961295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1789776413.961310:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1789776413.961317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432656512:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1789776413.961327:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789776413.961348:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432656512:12345-192.168.204.27@tcp:41: Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.961354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1789776413.966629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776413.966729:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657024 00000100:00100000:0.0:1789776413.966740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657024 00000100:00100000:0.0:1789776413.966802:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1789776413.966813:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657024:12345-192.168.204.27@tcp:40: 00000100:00100000:0.0:1789776413.966901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657024:12345-192.168.204.27@tcp:40: Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.966908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1789776413.968633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776413.968724:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657152 00000100:00100000:1.0:1789776413.968733:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657152 00000100:00100000:1.0:1789776413.968779:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1789776413.968786:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1876716432657152:12345-192.168.204.27@tcp:8: 00010000:00080000:1.0:1789776413.968817:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1789776413.968849:0:8434:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb884995 00002000:00100000:1.0:1789776413.968861:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1c6b552f-1300-40e3-a848-4343cb28ffe2/ffff8a5cfc24c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776413.968878:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776413.969059:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789776413.969328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776413.969653:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657408 00000100:00100000:0.0:1789776413.969658:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657408 00000100:00100000:0.0:1789776413.969696:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:0.0:1789776413.969703:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432657408:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1789776413.969761:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432657408:12345-192.168.204.27@tcp:400: Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.969768:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00080000:1.0:1789776413.970129:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2529800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776413.970209:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432657152:12345-192.168.204.27@tcp:8: Request processed in 1421us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.970216:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1789776413.974882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776413.974980:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657280 00000100:00100000:2.0:1789776413.974989:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657280 00000100:00100000:2.0:1789776413.975041:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776413.975050:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1876716432657280:12345-192.168.204.27@tcp:8: 00010000:00080000:2.0:1789776413.975085:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:2.0:1789776413.975149:0:8433:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb88499c 00002000:00100000:2.0:1789776413.975162:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1c6b552f-1300-40e3-a848-4343cb28ffe2/ffff8a5bc24d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789776413.975179:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789776413.975377:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789776413.975409:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776413.975482:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432657280:12345-192.168.204.27@tcp:8: Request processed in 430us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.975524:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1789776413.978584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776413.978948:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657536 00000100:00100000:2.0:1789776413.978958:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657536 00000100:00100000:2.0:1789776413.979019:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1789776413.979030:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657536:12345-192.168.204.27@tcp:900: 00000100:00100000:2.0:1789776413.979208:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657536:12345-192.168.204.27@tcp:900: Request processed in 168us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.979216:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1789776413.990231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776413.990430:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657664 00000100:00100000:3.0:1789776413.990440:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657664 00000100:00100000:3.0:1789776413.990525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1789776413.990537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657664:12345-192.168.204.27@tcp:33: 00000004:00080000:2.0:1789776414.022590:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31967us 00000004:00200000:2.0:1789776414.033219:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789776414.033345:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6167:x1876716432657664:12345-192.168.204.27@tcp:33: Request processed in 42805us (43987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776414.033369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:3.0:1789776414.114668:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776414.274340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776414.274654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657792 00000100:00100000:3.0:1789776414.274665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657792 00000100:00100000:3.0:1789776414.274732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1789776414.274743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6207:x1876716432657792:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1789776414.274778:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776414.274846:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256800/0xf13b8042cb8849a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5677 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.274913:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.274928:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.274943:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776414.274986:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776414.274990:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776414.275005:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.275030:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256800/0xf13b8042cb8849a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5677 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.275048:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5677 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776414.275056:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc33d3f00) 00010000:00010000:3.0:1789776414.275059:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776414.275063:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257e00, rc 0) 00000100:00100000:3.0:1789776414.275128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:6207:x1876716432657792:12345-192.168.204.27@tcp:101: Request processed in 387us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776414.275134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:2.0:1789776415.144240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776415.266839:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776415.266877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449480704:0@lo:13: 00000100:00100000:1.0:1789776415.266953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.267877:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776415.267928:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480704 00000100:00100000:3.0:1789776415.267936:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480704 00000100:00080000:0.0:1789776415.267987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776415.267992:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776415.268008:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449480704:12345-0@lo:13: 00000100:00100000:2.0:1789776415.268027:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449480832:0@lo:13: 00002000:00000024:3.0:1789776415.268033:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776415.268067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776415.268085:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449480704:12345-0@lo:13: Request processed in 80us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776415.268093:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789776415.268182:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35c700 x1876716449480704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776415.268202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449480704:0@lo:13: 00000100:00100000:3.0:1789776415.269687:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480832 00000100:00100000:3.0:1789776415.269698:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480832 00000100:00100000:3.0:1789776415.269770:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776415.269780:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449480832:12345-0@lo:13: 00002000:00000024:3.0:1789776415.269800:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776415.269866:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449480832:12345-0@lo:13: Request processed in 88us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776415.269873:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789776415.270011:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2695880 x1876716449480832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776415.270028:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449480832:0@lo:13: 00000100:00080000:1.0:1789776415.270103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776415.779597:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776415.779621:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449480960:0@lo:13: 00000100:00100000:3.0:1789776415.779691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776415.779765:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449480960 00000100:00100000:3.0:1789776415.779772:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449480960 00000100:00100000:3.0:1789776415.779820:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776415.779831:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449480960:12345-0@lo:13: 00002000:00000024:3.0:1789776415.779856:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776415.779898:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449480960:12345-0@lo:13: Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776415.779905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789776415.779943:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35c700 x1876716449480960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776415.779970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449480960:0@lo:13: 00000100:00100000:2.0:1789776415.780667:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449481216:0@lo:400: 00000100:00100000:2.0:1789776415.780717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780741:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449481728:0@lo:400: 00000100:00100000:2.0:1789776415.780763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780792:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449482240:0@lo:400: 00000100:00100000:2.0:1789776415.780812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789776415.780840:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449481088:0@lo:400: 00000100:00100000:2.0:1789776415.780862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780877:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449481600:0@lo:400: 00000100:00100000:2.0:1789776415.780895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780908:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449482112:0@lo:400: 00000100:00100000:2.0:1789776415.780938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.780963:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481216 00000100:00100000:2.0:1789776415.780968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481216 00000100:00100000:2.0:1789776415.780992:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481728 00000100:00100000:2.0:1789776415.780994:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481728 00000100:00100000:2.0:1789776415.781004:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482240 00000100:00100000:2.0:1789776415.781006:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482240 00000100:00100000:2.0:1789776415.781017:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789776415.781024:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449481216:12345-0@lo:400: 00000100:00100000:2.0:1789776415.781061:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449481216:12345-0@lo:400: Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.781067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789776415.781079:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776415.781084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449481728:12345-0@lo:400: 00000100:00100000:2.0:1789776415.781103:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449481728:12345-0@lo:400: Request processed in 20us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.781109:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776415.781118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776415.781123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449482240:12345-0@lo:400: 00000100:00100000:2.0:1789776415.781152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449482240:12345-0@lo:400: Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.781157:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776415.781185:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481088 00000100:00100000:2.0:1789776415.781188:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481088 00000100:00100000:2.0:1789776415.781210:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789776415.781216:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449481088:12345-0@lo:400: 00000100:00100000:2.0:1789776415.781253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449481088:12345-0@lo:400: Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00080000:1.0:1789776415.781553:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776415.781558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776415.781621:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449481472:0@lo:400: 00000100:00100000:1.0:1789776415.781660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449481984:0@lo:400: 00000100:00100000:1.0:1789776415.781719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781738:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449482496:0@lo:400: 00000100:00100000:1.0:1789776415.781759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781780:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789776415.781786:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449481344:0@lo:400: 00000100:00100000:1.0:1789776415.781808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449481856:0@lo:400: 00000100:00100000:1.0:1789776415.781845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449482368:0@lo:400: 00000100:00100000:1.0:1789776415.781875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776415.781897:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482112 00000100:00100000:1.0:1789776415.781900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482112 00000100:00100000:1.0:1789776415.781929:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481984 00000100:00100000:1.0:1789776415.781932:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481984 00000100:00100000:1.0:1789776415.781944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482496 00000100:00100000:1.0:1789776415.781946:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482496 00000100:00100000:1.0:1789776415.781966:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776415.781973:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449482112:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782007:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449482112:12345-0@lo:400: Request processed in 35us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.782013:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776415.782039:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776415.782045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449481984:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782075:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449481984:12345-0@lo:400: Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.782088:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776415.782102:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776415.782108:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449482496:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782136:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449482496:12345-0@lo:400: Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.782141:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789776415.782155:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776415.782174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481600 00000100:00100000:1.0:1789776415.782177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481600 00000100:00100000:1.0:1789776415.782200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481344 00000100:00100000:1.0:1789776415.782203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481344 00000100:00100000:1.0:1789776415.782216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776415.782222:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449481600:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449481600:12345-0@lo:400: Request processed in 33us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.782578:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789776415.782618:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776415.782625:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449481344:12345-0@lo:400: 00000100:00100000:2.0:1789776415.782658:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449481344:12345-0@lo:400: Request processed in 33us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.782664:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789776415.782779:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776415.782799:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481472 00000100:00100000:1.0:1789776415.782802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481472 00000100:00100000:1.0:1789776415.782817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449481856 00000100:00100000:1.0:1789776415.782820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449481856 00000100:00100000:1.0:1789776415.782837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482368 00000100:00100000:1.0:1789776415.782840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482368 00000100:00100000:1.0:1789776415.782852:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776415.782857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449481472:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782889:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449481472:12345-0@lo:400: Request processed in 32us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.782895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776415.782909:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776415.782923:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449481856:12345-0@lo:400: 00000100:00100000:1.0:1789776415.782952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449481856:12345-0@lo:400: Request processed in 30us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.782958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776415.782971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776415.782978:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449482368:12345-0@lo:400: 00000100:00100000:1.0:1789776415.783020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449482368:12345-0@lo:400: Request processed in 43us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776415.783027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789776415.783045:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776415.783081:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449481344:0@lo:400: 00010000:00080000:1.0:1789776415.783097:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43aa00 x1876716449481856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776415.783107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449481856:0@lo:400: 00010000:00080000:1.0:1789776415.783118:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43b100 x1876716449482368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776415.783127:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449482368:0@lo:400: 00000100:00100000:1.0:1789776415.783139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449481472:0@lo:400: 00010000:00080000:1.0:1789776415.783149:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff439180 x1876716449481984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776415.783157:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449481984:0@lo:400: 00010000:00080000:1.0:1789776415.783180:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43b480 x1876716449482496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776415.783188:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789776415.783210:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449482496:0@lo:400: 00000100:00100000:2.0:1789776415.783413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449481088:0@lo:400: 00000100:00100000:2.0:1789776415.783424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449481600:0@lo:400: 00010000:00080000:2.0:1789776415.783436:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43a300 x1876716449482112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776415.783444:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449482112:0@lo:400: 00000100:00100000:2.0:1789776415.783457:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449481216:0@lo:400: 00000100:00100000:2.0:1789776415.783469:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449481728:0@lo:400: 00000100:00100000:2.0:1789776415.783480:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449482240:0@lo:400: 00000100:00100000:2.0:1789776415.783526:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776415.783537:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449482624:0@lo:13: 00000100:00100000:2.0:1789776415.783568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776415.783603:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482624 00000100:00100000:2.0:1789776415.783607:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482624 00000100:00100000:2.0:1789776415.783634:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776415.783641:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449482624:12345-0@lo:13: 00002000:00000024:2.0:1789776415.783661:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789776415.784003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f7b80 x1876716449482624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776415.784018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449482624:0@lo:13: 00000100:00100000:2.0:1789776415.784071:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449482624:12345-0@lo:13: Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776415.784078:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000001:00100000:3.0:1789776415.786193:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000001:00080000:3.0:1789776415.786476:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1789776416.163486:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776416.571612:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776416.571726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432657920 00000100:00100000:1.0:1789776416.571737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432657920 00000100:00100000:1.0:1789776416.571824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1789776416.571835:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:6260:x1876716432657920:12345-192.168.204.27@tcp:41: 00000004:00000024:1.0:1789776416.571872:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789776416.571940:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:6260:x1876716432657920:12345-192.168.204.27@tcp:41: Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776416.571947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:2.0:1789776416.573633:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776416.575430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776416.575530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658048 00000100:00100000:3.0:1789776416.575540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658048 00000100:00100000:3.0:1789776416.575604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:3.0:1789776416.575613:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6260:x1876716432658048:12345-192.168.204.27@tcp:41: 00000004:00000024:3.0:1789776416.575652:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776416.575726:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6260:x1876716432658048:12345-192.168.204.27@tcp:41: Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776416.575733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:2.0:1789776416.576079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776416.585456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776416.585779:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658176 00000100:00100000:0.0:1789776416.585789:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658176 00000100:00100000:0.0:1789776416.585865:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1789776416.585876:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6260:x1876716432658176:12345-192.168.204.27@tcp:13: 00002000:00000024:0.0:1789776416.585907:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776416.585969:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:6260:x1876716432658176:12345-192.168.204.27@tcp:13: Request processed in 94us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776416.585977:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00080000:1.0:1789776416.586761:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776416.593609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776416.595354:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658304 00000100:00100000:2.0:1789776416.595366:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658304 00000100:00100000:2.0:1789776416.595451:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1789776416.595463:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:6260:x1876716432658304:12345-192.168.204.27@tcp:13: 00002000:00000024:2.0:1789776416.595490:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776416.595593:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:6260:x1876716432658304:12345-192.168.204.27@tcp:13: Request processed in 133us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776416.595601:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00080000:1.0:1789776416.596696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789776417.188187:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776418.211555:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776418.850777:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449482752:0@lo:41: 00000100:00100000:3.0:1789776418.850847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776418.850981:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776418.850991:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449482880:0@lo:41: 00000100:00100000:1.0:1789776418.851019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776418.851052:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482752 00000100:00100000:1.0:1789776418.851060:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482752 00000100:00100000:1.0:1789776418.851119:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449482880 00000100:00100000:1.0:1789776418.851123:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449482880 00000100:00100000:1.0:1789776418.851153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776418.851163:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449482752:12345-0@lo:41: 00000004:00000024:1.0:1789776418.851197:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776418.851240:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449482752:12345-0@lo:41: Request processed in 79us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.851247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776418.851289:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776418.851296:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449482880:12345-0@lo:41: 00000004:00000024:1.0:1789776418.851327:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789776418.851360:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449482880:12345-0@lo:41: Request processed in 65us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.851367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776418.851410:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449482880:0@lo:41: 00000100:00100000:1.0:1789776418.851445:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449482752:0@lo:41: 00000001:00100000:1.0:1789776418.857748:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000001:00100000:2.0:1789776418.862332:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000100:00100000:0.0:1789776419.010349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776419.010405:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776419.010437:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776419.010464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776419.010490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776419.010681:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658944 00000100:00100000:3.0:1789776419.010700:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658944 00000100:00100000:0.0:1789776419.010733:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658688 00000100:00100000:0.0:1789776419.010744:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658688 00000100:00100000:3.0:1789776419.010803:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658816 00000100:00100000:3.0:1789776419.010809:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658816 00000100:00100000:0.0:1789776419.010817:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658560 00000100:00100000:0.0:1789776419.010823:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658560 00000100:00100000:3.0:1789776419.010863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1789776419.010872:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1789776419.010885:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432658944:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1789776419.010890:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432658688:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1789776419.011016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432658432 00000100:00100000:1.0:1789776419.011021:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432658432 00000100:00100000:1.0:1789776419.011054:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:1.0:1789776419.011062:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432658432:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1789776419.011294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432658688:12345-192.168.204.27@tcp:400: Request processed in 409us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776419.011303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1789776419.011322:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1789776419.011330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432658560:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1789776419.014683:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432658944:12345-192.168.204.27@tcp:400: Request processed in 3786us (4224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776419.014704:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1789776419.014758:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1789776419.014776:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432658816:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1789776419.014838:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432658816:12345-192.168.204.27@tcp:400: Request processed in 70us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776419.014845:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00080000:3.0:1789776419.014877:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776419.014884:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776419.014888:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776419.014892:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776419.019345:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432658432:12345-192.168.204.27@tcp:400: Request processed in 8270us (8994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776419.019362:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:0.0:1789776419.020747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432658560:12345-192.168.204.27@tcp:400: Request processed in 9409us (10272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776419.020759:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00010000:00010000:0.0:1789776419.235601:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776419.353368:0:10181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1789776419.885059:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00010000:00010000:3.0:1789776420.258713:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776420.389792:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449483008:0@lo:13: 00000100:00100000:0.0:1789776420.389861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776420.389937:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483008 00000100:00100000:0.0:1789776420.389945:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483008 00000100:00100000:0.0:1789776420.390007:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776420.390026:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449483008:12345-0@lo:13: 00002000:00000024:0.0:1789776420.390057:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776420.390114:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449483008:12345-0@lo:13: Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.390122:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789776420.390143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776420.390170:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2695180 x1876716449483008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776420.390186:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449483008:0@lo:13: 00000100:00100000:3.0:1789776420.392963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776420.392986:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449483136:0@lo:13: 00000100:00100000:3.0:1789776420.393295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776420.395343:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483136 00000100:00100000:0.0:1789776420.395367:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483136 00000100:00100000:0.0:1789776420.395634:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789776420.395646:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449483136:12345-0@lo:13: 00002000:00000024:0.0:1789776420.395670:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776420.395751:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449483136:12345-0@lo:13: Request processed in 108us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.395758:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789776420.395809:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e300 x1876716449483136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776420.395832:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449483136:0@lo:13: 00000100:00080000:3.0:1789776420.396197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776420.899425:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449483264:0@lo:13: 00000100:00100000:1.0:1789776420.899976:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776420.899992:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449483392:0@lo:13: 00000100:00100000:1.0:1789776420.900049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.900130:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483392 00000100:00100000:1.0:1789776420.900138:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483392 00000100:00100000:2.0:1789776420.900197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.900208:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483264 00000100:00100000:1.0:1789776420.900212:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483264 00000100:00100000:1.0:1789776420.900239:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776420.900248:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449483392:12345-0@lo:13: 00002000:00000024:1.0:1789776420.900278:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776420.900331:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449483392:12345-0@lo:13: Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776420.900352:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776420.900386:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776420.900395:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449483264:12345-0@lo:13: 00002000:00000024:1.0:1789776420.900407:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776420.900444:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449483264:12345-0@lo:13: Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776420.900451:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789776420.900473:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776420.900530:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449483520:0@lo:400: 00000100:00100000:2.0:1789776420.900542:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449483648:0@lo:400: 00000100:00100000:1.0:1789776420.900566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776420.900594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.900601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449484032:0@lo:400: 00000100:00100000:1.0:1789776420.900629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.900646:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449484544:0@lo:400: 00000100:00100000:1.0:1789776420.900670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789776420.900701:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f6300 x1876716449483392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776420.900722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449483392:0@lo:13: 00000100:00100000:2.0:1789776420.900734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449484160:0@lo:400: 00000100:00100000:1.0:1789776420.900743:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789776420.900753:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449483904:0@lo:400: 00000100:00100000:2.0:1789776420.900761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776420.900785:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449484672:0@lo:400: 00000100:00100000:1.0:1789776420.900792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776420.902585:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449483776:0@lo:400: 00000100:00100000:3.0:1789776420.902678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776420.902724:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449484288:0@lo:400: 00000100:00100000:0.0:1789776420.906118:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484032 00000100:00100000:0.0:1789776420.906134:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484032 00000100:00100000:0.0:1789776420.906181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483776 00000100:00100000:0.0:1789776420.906185:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483776 00000100:00100000:0.0:1789776420.906203:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776420.906214:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449484032:12345-0@lo:400: 00000100:00100000:0.0:1789776420.906305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449484032:12345-0@lo:400: Request processed in 93us (5675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.906319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776420.908560:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776420.908588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449483776:12345-0@lo:400: 00000100:00100000:0.0:1789776420.908714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449483776:12345-0@lo:400: Request processed in 139us (6037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.908721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776420.908753:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483520 00000100:00100000:0.0:1789776420.908761:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483520 00000100:00100000:0.0:1789776420.908803:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789776420.908810:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449483520:12345-0@lo:400: 00000100:00100000:0.0:1789776420.908842:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449483520:12345-0@lo:400: Request processed in 33us (8277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.908848:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789776420.908921:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484544 00000100:00100000:0.0:1789776420.908926:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484544 00000100:00100000:0.0:1789776420.908963:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776420.908972:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449484544:12345-0@lo:400: 00000100:00100000:1.0:1789776420.909006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776420.909357:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449484544:12345-0@lo:400: Request processed in 386us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776420.909364:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776420.924727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483648 00000100:00100000:2.0:1789776420.924745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483648 00000100:00100000:2.0:1789776420.924808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484160 00000100:00100000:2.0:1789776420.924812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484160 00000100:00100000:2.0:1789776420.924845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449483904 00000100:00100000:2.0:1789776420.924847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449483904 00000100:00100000:2.0:1789776420.924857:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484288 00000100:00100000:2.0:1789776420.924859:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484288 00000100:00100000:2.0:1789776420.924879:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789776420.924889:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449483648:12345-0@lo:400: 00000100:00100000:2.0:1789776420.925269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449483648:12345-0@lo:400: Request processed in 380us (24675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776420.925278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789776420.925296:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776420.925304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449484160:12345-0@lo:400: 00000100:00100000:2.0:1789776420.925334:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449484160:12345-0@lo:400: Request processed in 31us (24572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776420.925340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776420.925350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776420.925356:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449483904:12345-0@lo:400: 00000100:00100000:2.0:1789776420.925383:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449483904:12345-0@lo:400: Request processed in 28us (24596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776420.925389:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776420.925413:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776420.925419:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449484288:12345-0@lo:400: 00000100:00100000:2.0:1789776420.925445:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449484288:12345-0@lo:400: Request processed in 27us (16441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776420.925451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789776420.925832:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776420.925836:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776420.927310:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43df80 x1876716449484288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776420.927328:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449484288:0@lo:400: 00000100:00100000:1.0:1789776420.927351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449484800:0@lo:400: 00000100:00100000:1.0:1789776420.927408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789776420.927445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43ca80 x1876716449483264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776420.927453:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789776420.927475:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449483264:0@lo:13: 00000100:00100000:1.0:1789776420.927517:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449483776:0@lo:400: 00000100:00100000:1.0:1789776420.927555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.927720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449483648:0@lo:400: 00000100:00100000:1.0:1789776420.927734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449484160:0@lo:400: 00000100:00100000:1.0:1789776420.927758:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484800 00000100:00100000:1.0:1789776420.927764:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484800 00000100:00080000:2.0:1789776420.927796:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776420.927811:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484672 00000100:00100000:1.0:1789776420.927815:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484672 00000100:00100000:1.0:1789776420.927849:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776420.927857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449484800:12345-0@lo:400: 00000100:00100000:1.0:1789776420.927905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449484800:12345-0@lo:400: Request processed in 49us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776420.927912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776420.927938:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789776420.927944:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449484672:12345-0@lo:400: 00000100:00100000:1.0:1789776420.927978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449484672:12345-0@lo:400: Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776420.927984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789776420.928014:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449484672:0@lo:400: 00010000:00080000:1.0:1789776420.928052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43f800 x1876716449484800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776420.928075:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449484800:0@lo:400: 00000100:00100000:1.0:1789776420.928107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449483904:0@lo:400: 00000100:00100000:1.0:1789776420.928116:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449484416:0@lo:400: 00000100:00100000:1.0:1789776420.928147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776420.928173:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449484416 00000100:00100000:0.0:1789776420.928274:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449483520:0@lo:400: 00000100:00100000:0.0:1789776420.928291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449484032:0@lo:400: 00010000:00080000:0.0:1789776420.928305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43d500 x1876716449484544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776420.928314:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449484544:0@lo:400: 00000100:00080000:2.0:1789776420.929297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776420.929766:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449484416 00000100:00100000:1.0:1789776420.929826:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776420.929837:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449484416:12345-0@lo:400: 00000100:00100000:1.0:1789776420.929933:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449484416:12345-0@lo:400: Request processed in 98us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776420.929941:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789776420.930007:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43c380 x1876716449484416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776420.930021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449484416:0@lo:400: 00010000:00010000:0.0:1789776421.284168:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776422.309002:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776422.914902:0:10328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd85a10bc0 20000000:00000080:0.0:1789776422.914919:0:10328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5bc3677000 uarg=0000000000000000 20000000:01000000:0.0:1789776422.914959:0:10328:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789776422.914962:0:10328:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789776422.914964:0:10328:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789776422.914969:0:10328:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789776422.914974:0:10328:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789776422.915048:0:10328:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789776422.915050:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789776422.915699:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789776422.916095:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789776422.916128:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789776422.916144:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789776422.916155:0:10328:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789776422.916157:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789776422.917112:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789776422.917358:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789776422.917378:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789776422.917390:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789776422.917398:0:10328:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789776422.917400:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789776422.917743:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789776422.917865:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789776422.917881:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789776422.917893:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789776422.917900:0:10328:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789776422.917902:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789776422.918743:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789776422.918906:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789776422.918928:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789776422.918942:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1789776422.918952:0:10328:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789776422.918954:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789776422.919350:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789776422.919476:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789776422.919526:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789776422.919543:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1789776422.919555:0:10328:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789776422.919575:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919599:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884845 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919607:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88486f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919613:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919620:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919627:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919633:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919640:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884909 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919647:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919654:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884956 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919663:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919682:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.919689:0:10328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.920035:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.920050:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 9 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.920166:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449484928:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776422.920324:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.920333:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 9 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.920342:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485056:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776422.920369:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.920377:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.920386:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485184:0@lo:104: 00000100:00100000:0.0:1789776422.920420:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776422.920466:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.920474:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.920482:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485312:0@lo:104: 00000100:00100000:3.0:1789776422.920544:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485184 00000100:00100000:3.0:1789776422.920558:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485184 00000100:00100000:3.0:1789776422.920611:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776422.920629:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10328:x1876716449485184:12345-0@lo:104: 00010000:00010000:3.0:1789776422.920640:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.922663:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776422.922678:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10328:x1876716449485184:12345-0@lo:104: Request processed in 2056us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.922688:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789776422.922688:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776422.922696:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.922706:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0800 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776422.922710:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.922720:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776422.922726:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776422.922743:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776422.922790:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.922796:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776422.922812:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.922820:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb884956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88495d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.922840:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776422.922842:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776422.922843:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776422.923842:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449485440:0@lo:103: 00000100:00100000:3.0:1789776422.923902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776422.924388:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485440 00000100:00100000:2.0:1789776422.924395:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485440 00010000:00010000:2.0:1789776422.924429:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 24 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.924678:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776422.924689:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfae81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449485440:12345-0@lo:103: 00010000:00010000:3.0:1789776422.924703:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.924709:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 24 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.924719:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 24 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.924741:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.924790:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfae81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449485440:12345-0@lo:103: Request processed in 103us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.924797:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776422.926091:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449485440:0@lo:103: 00000100:00100000:0.0:1789776422.926521:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776422.926582:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.926595:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.926608:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485568:0@lo:104: 00000100:00100000:0.0:1789776422.926638:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776422.926695:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926702:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485312 00010000:00010000:0.0:1789776422.926704:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 23 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926708:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485312 00000100:00100000:0.0:1789776422.926712:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485696:0@lo:104: 00000100:00100000:1.0:1789776422.926735:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485568 00000100:00100000:1.0:1789776422.926738:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485568 00000100:00100000:0.0:1789776422.926744:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776422.926766:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926774:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789776422.926775:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.926783:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485824:0@lo:104: 00000100:00100000:1.0:1789776422.926791:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485696 00000100:00100000:1.0:1789776422.926794:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485696 00000100:00100000:0.0:1789776422.926808:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776422.926811:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776422.926819:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:10328:x1876716449485312:12345-0@lo:104: 00010000:00010000:0.0:1789776422.926824:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.926830:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.926831:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.926853:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485952:0@lo:104: 00000100:00100000:0.0:1789776422.926870:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776422.926878:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776422.926883:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:10328:x1876716449485312:12345-0@lo:104: Request processed in 66us (363us total) trans 0 rc 0/0 00010000:00010000:0.0:1789776422.926886:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.926894:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 23 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776422.926902:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486080:0@lo:104: 00000100:00100000:0.0:1789776422.926918:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776422.926922:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485824 00000100:00100000:1.0:1789776422.926925:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485824 00010000:00010000:0.0:1789776422.926933:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449485952 00000100:00100000:1.0:1789776422.926937:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449485952 00010000:00010000:0.0:1789776422.926941:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.926945:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486080 00000100:00100000:1.0:1789776422.926947:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486080 00000100:00100000:0.0:1789776422.926949:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486208:0@lo:104: 00000100:00100000:1.0:1789776422.926956:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776422.926960:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:10328:x1876716449485568:12345-0@lo:104: 00000100:00100000:0.0:1789776422.926965:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776422.926968:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.926979:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776422.926986:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 23 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.927004:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486336:0@lo:104: 00010000:00010000:1.0:1789776422.927005:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776422.927010:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:10328:x1876716449485568:12345-0@lo:104: Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.927015:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776422.927037:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776422.927048:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7faecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789776422.927080:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342c400/0xf13b8042cb88495d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884956 expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.927093:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485184:0@lo:104: 00000100:00100000:0.0:1789776422.927102:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485312:0@lo:104: 00000100:00100000:0.0:1789776422.927109:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485568:0@lo:104: 00000100:00100000:1.0:1789776422.927168:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486208 00000100:00100000:1.0:1789776422.927172:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486208 00000100:00100000:1.0:1789776422.927184:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486336 00000100:00100000:1.0:1789776422.927187:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486336 00000100:00100000:1.0:1789776422.927355:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776422.927365:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc1a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:10328:x1876716449485696:12345-0@lo:104: 00010000:00010000:1.0:1789776422.927373:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.927425:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776422.927430:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc1a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+8:10328:x1876716449485696:12345-0@lo:104: Request processed in 69us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.927436:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776422.927477:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776422.927483:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:10328:x1876716449485824:12345-0@lo:104: 00010000:00010000:1.0:1789776422.927507:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927565:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776422.927572:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927580:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342de00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776422.927583:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927591:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776422.927605:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776422.927610:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776422.927640:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927645:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776422.927661:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927667:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342de00/0xf13b8042cb88492c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884933 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927676:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776422.927679:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927684:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256a00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776422.927687:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927692:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776422.927698:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776422.927702:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776422.927722:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927728:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776422.927742:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927748:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256a00/0xf13b8042cb884909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884910 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927758:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776422.927761:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927766:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776422.927769:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927774:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776422.927780:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776422.927785:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776422.927797:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927802:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776422.927806:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927821:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb8848e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.927844:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776422.927845:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776422.927847:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776422.927855:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776422.927865:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449486464:0@lo:103: 00000100:00100000:0.0:1789776422.927896:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485696:0@lo:104: 00010000:00010000:1.0:1789776422.928569:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776422.928578:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+7:10328:x1876716449485824:12345-0@lo:104: Request processed in 1094us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.928586:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776422.928625:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776422.928636:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:10328:x1876716449485952:12345-0@lo:104: 00010000:00010000:1.0:1789776422.928646:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.928660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776422.928680:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776422.928686:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:10328:x1876716449485952:12345-0@lo:104: Request processed in 54us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.928691:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776422.928708:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776422.928715:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:10328:x1876716449486080:12345-0@lo:104: 00010000:00010000:1.0:1789776422.928722:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.928749:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776422.928753:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:10328:x1876716449486080:12345-0@lo:104: Request processed in 40us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.928758:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776422.928782:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776422.928788:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:10328:x1876716449486208:12345-0@lo:104: 00010000:00010000:1.0:1789776422.928795:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.928822:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789776422.928827:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:10328:x1876716449486208:12345-0@lo:104: Request processed in 40us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.928832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776422.928846:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776422.928852:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10328:x1876716449486336:12345-0@lo:104: 00010000:00010000:1.0:1789776422.928859:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.928881:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789776422.928886:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10328:x1876716449486336:12345-0@lo:104: Request processed in 35us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776422.928890:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789776422.928908:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789776422.928913:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.928919:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fe00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776422.928922:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.928930:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776422.928947:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776422.928952:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789776422.928985:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486464 00010000:00010000:1.0:1789776422.928985:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.928990:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486464 00010000:00010000:1.0:1789776422.928991:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776422.929004:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929009:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb8848ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929011:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929031:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789776422.929035:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929041:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776422.929044:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.929045:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789776422.929050:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.929052:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3643:x1876716449486464:12345-0@lo:103: 10000000:00010000:1.0:1789776422.929057:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776422.929062:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776422.929148:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929156:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776422.929163:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929169:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256600/0xf13b8042cb8848bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929172:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789776422.929174:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449486976:0@lo:103: 00010000:00010000:2.0:1789776422.929179:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929180:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789776422.929184:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929190:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929205:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb884933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88492c expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.929214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776422.929249:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789776422.929256:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776422.929262:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.929263:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449486848:0@lo:103: 00010000:00010000:1.0:1789776422.929276:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929282:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1789776422.929284:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776422.929289:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789776422.929293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776422.929310:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929317:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789776422.929319:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3643:x1876716449486464:12345-0@lo:103: Request processed in 267us (659us total) trans 0 rc 0/0 00010000:00010000:1.0:1789776422.929322:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.929328:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486976 00000100:00100000:2.0:1789776422.929333:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776422.929334:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486976 00010000:00010000:1.0:1789776422.929340:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f000/0xf13b8042cb8848ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8848b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.929349:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486848 00010000:00010000:1.0:1789776422.929351:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789776422.929352:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486848 00010000:00010000:1.0:1789776422.929354:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929360:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0030a00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776422.929364:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.929366:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929367:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929374:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.929382:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776422.929391:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3644:x1876716449486848:12345-0@lo:103: 10000000:00010000:1.0:1789776422.929393:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776422.929398:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776422.929399:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776422.929403:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.929406:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789776422.929418:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.929420:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3644:x1876716449486976:12345-0@lo:103: 00010000:00010000:1.0:1789776422.929430:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776422.929433:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776422.929437:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.929440:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929453:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc0030a00/0xf13b8042cb88486f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884876 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929464:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776422.929473:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929479:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776422.929482:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929488:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.929565:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776422.929690:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776422.929696:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776422.929715:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929721:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776422.929745:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929753:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256400/0xf13b8042cb884845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb88484c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.929767:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776422.929769:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776422.929771:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776422.929779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776422.929792:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.929793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449486592:0@lo:103: 00010000:00010000:3.0:1789776422.929811:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776422.929828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776422.929854:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449487104:0@lo:103: 00000100:00100000:3.0:1789776422.929952:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3644:x1876716449486976:12345-0@lo:103: Request processed in 536us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.929959:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776422.929970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776422.929977:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486592 00000100:00100000:3.0:1789776422.929990:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486592 00000100:00100000:1.0:1789776422.929990:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776422.930000:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449486720:0@lo:103: 00010000:00010000:3.0:1789776422.930006:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 23 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.930030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487104 00000100:00100000:3.0:1789776422.930034:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487104 00000100:00100000:1.0:1789776422.930039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776422.930049:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.930054:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449487232:0@lo:103: 00000100:00100000:3.0:1789776422.930063:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449486720 00000100:00100000:3.0:1789776422.930073:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449486720 00010000:00010000:3.0:1789776422.930087:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 25 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.930098:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789776422.930104:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3645:x1876716449486592:12345-0@lo:103: 00010000:00010000:3.0:1789776422.930110:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.930114:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 25 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930122:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 25 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930133:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884909 expref: 25 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930142:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776422.930148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776422.930172:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449486592:12345-0@lo:103: Request processed in 67us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.930179:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776422.930183:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449486592:0@lo:103: 00000100:00100000:3.0:1789776422.930190:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487232 00000100:00100000:3.0:1789776422.930194:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487232 00010000:00010000:3.0:1789776422.930203:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 24 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.930213:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789776422.930218:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449487104:12345-0@lo:103: 00010000:00010000:3.0:1789776422.930236:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.930239:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930259:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930271:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776422.930276:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449487360:0@lo:103: 00000100:00100000:3.0:1789776422.930301:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449487104:12345-0@lo:103: Request processed in 81us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.930312:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776422.930315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776422.930326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487360 00000100:00100000:3.0:1789776422.930331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487360 00010000:00010000:3.0:1789776422.930344:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.930347:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449486464:0@lo:103: 00010000:00010000:1.0:1789776422.930367:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776422.930377:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776422.930384:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449486720:12345-0@lo:103: 00010000:00010000:3.0:1789776422.930390:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.930394:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930402:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930418:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb8848ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8848e6 expref: 24 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930427:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.930445:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3645:x1876716449486720:12345-0@lo:103: Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.930450:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776422.930460:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776422.930472:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfae80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3645:x1876716449487232:12345-0@lo:103: 00010000:00010000:3.0:1789776422.930479:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.930484:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930507:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930518:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.930542:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfae80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3645:x1876716449487232:12345-0@lo:103: Request processed in 71us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.930549:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776422.930569:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776422.930575:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449487360:12345-0@lo:103: 00010000:00010000:3.0:1789776422.930583:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.930588:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 21 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.930597:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 21 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776422.930599:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485824:0@lo:104: 00010000:00010000:3.0:1789776422.930613:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.930636:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449487360:12345-0@lo:103: Request processed in 62us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.930642:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776422.930678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776422.930739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776422.930761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449486976:0@lo:103: 00000100:00100000:3.0:1789776422.930788:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659072 00000100:00100000:3.0:1789776422.930790:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659072 00010000:00010000:3.0:1789776422.930802:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 10 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.930813:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659200 00000100:00100000:3.0:1789776422.930815:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659200 00010000:00010000:3.0:1789776422.930822:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 11 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776422.930832:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1789776422.930837:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:2412:x1876716432659072:12345-192.168.204.27@tcp:103: 00010000:00010000:3.0:1789776422.930845:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789776422.931222:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449487360:0@lo:103: 00010000:00010000:3.0:1789776422.931337:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 11 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.931478:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 11 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.931490:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.931546:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:2412:x1876716432659072:12345-192.168.204.27@tcp:103: Request processed in 707us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.931554:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1789776422.931570:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1789776422.931577:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432659200:12345-192.168.204.27@tcp:103: 00010000:00010000:3.0:1789776422.931585:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776422.931590:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 10 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.931612:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 10 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776422.931622:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776422.931695:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432659200:12345-192.168.204.27@tcp:103: Request processed in 119us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776422.931702:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1789776422.931770:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449486720:0@lo:103: 00000100:00100000:3.0:1789776422.931778:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449487232:0@lo:103: 00000100:00100000:3.0:1789776422.931785:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449487104:0@lo:103: 00010000:00010000:1.0:1789776422.932588:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030600/0xf13b8042cb8848c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8848bc expref: 20 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932603:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485952:0@lo:104: 00010000:00010000:1.0:1789776422.932615:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217ea00/0xf13b8042cb8848b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8848ae expref: 19 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932623:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486080:0@lo:104: 00010000:00010000:1.0:1789776422.932632:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217fa00/0xf13b8042cb884876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88486f expref: 18 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932641:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486208:0@lo:104: 00010000:00010000:1.0:1789776422.932652:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb88484c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884845 expref: 17 pid: 6509 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932672:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449486336:0@lo:104: 00010000:00010000:1.0:1789776422.932690:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342da00/0xf13b8042cb884972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab560e expref: 9 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932698:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449484928:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776422.932707:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc256e00/0xf13b8042cb88496b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5607 expref: 8 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776422.932716:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1876716449485056:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776422.932762:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934534:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030000/0xf13b8042cb8848d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8848ca expref: 16 pid: 6510 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934556:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934566:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934589:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934597:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934604:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934623:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934631:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf1800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776422.934634:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934643:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934709:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.934719:0:10328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776422.934722:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776422.934732:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776422.934739:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf1800/0xf13b8042cb8849b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776422.934810:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:3644:x1876716449486848:12345-0@lo:103: Request processed in 5418us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776422.934820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776422.935111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449486848:0@lo:103: 00010000:00010000:1.0:1789776423.330704:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776423.970977:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776423.971019:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449487488:0@lo:41: 00000100:00100000:1.0:1789776423.971172:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.971603:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776423.971634:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487488 00000100:00100000:0.0:1789776423.971641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487488 00000100:00100000:0.0:1789776423.971686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776423.971695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449487488:12345-0@lo:41: 00000004:00000024:0.0:1789776423.971726:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776423.971774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449487488:12345-0@lo:41: Request processed in 81us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776423.971781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776423.971824:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449487488:0@lo:41: 00000100:00100000:2.0:1789776423.972811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449487616:0@lo:41: 00000100:00100000:2.0:1789776423.972872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776423.974233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487616 00000100:00100000:0.0:1789776423.974245:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487616 00000100:00100000:0.0:1789776423.974304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789776423.974314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449487616:12345-0@lo:41: 00000004:00000024:0.0:1789776423.974349:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776423.975666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449487616:12345-0@lo:41: Request processed in 1351us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776423.975675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776423.975775:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449487616:0@lo:41: 00000100:00100000:3.0:1789776424.123612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776424.123656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776424.123684:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659328 00000100:00100000:3.0:1789776424.123689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776424.123694:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659328 00000100:00100000:3.0:1789776424.123705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776424.123741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:1.0:1789776424.123765:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:2413:x1876716432659328:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1789776424.123781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776424.123820:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659456 00000100:00100000:3.0:1789776424.123824:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659456 00000100:00100000:1.0:1789776424.123835:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:2413:x1876716432659328:12345-192.168.204.27@tcp:400: Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.123843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:3.0:1789776424.123869:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659584 00000100:00100000:3.0:1789776424.123872:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659584 00000100:00100000:3.0:1789776424.123899:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1789776424.123906:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432659456:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1789776424.123952:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789776424.123954:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432659456:12345-192.168.204.27@tcp:400: Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.123959:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789776424.124135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659712 00000100:00100000:0.0:1789776424.124149:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659712 00000100:00100000:0.0:1789776424.124181:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659840 00000100:00100000:0.0:1789776424.124184:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659840 00000100:00100000:0.0:1789776424.124208:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1789776424.124214:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432659712:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1789776424.124247:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432659712:12345-192.168.204.27@tcp:400: Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.124254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1789776424.124268:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1789776424.124274:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432659840:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1789776424.124295:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432659840:12345-192.168.204.27@tcp:400: Request processed in 22us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.124301:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1789776424.125837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1789776424.125866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1789776424.125885:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432659584:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1789776424.125946:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432659584:12345-192.168.204.27@tcp:400: Request processed in 70us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.125954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00080000:1.0:1789776424.125991:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776424.126009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776424.126012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776424.126015:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789776424.162642:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776424.162652:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc1a65000 from 48 10000000:01000000:3.0:1789776424.162657:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776424.162713:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.162726:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.162738:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.162766:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449487744:0@lo:101: 00000100:00100000:3.0:1789776424.162846:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.162903:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.162928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487744 00000100:00100000:1.0:1789776424.162938:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487744 00000100:00100000:1.0:1789776424.163012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789776424.163023:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+15:6514:x1876716449487744:12345-0@lo:101: 00010000:00010000:1.0:1789776424.163039:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776424.163056:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1000/0xf13b8042cb8849bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849b8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.163081:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1000/0xf13b8042cb8849bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849b8 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.163093:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1000/0xf13b8042cb8849bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849b8 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.163124:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1000, rc 0) 00000100:00100000:1.0:1789776424.163194:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449487744:12345-0@lo:101: Request processed in 173us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.163200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789776424.164012:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449487744:0@lo:101: 00010000:00010000:3.0:1789776424.164033:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.164044:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.164128:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449487872:0@lo:501: 00000100:00100000:3.0:1789776424.164164:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.164245:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.164438:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449487872 00000100:00100000:0.0:1789776424.164445:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449487872 00000100:00100000:0.0:1789776424.164555:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789776424.164566:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449487872:12345-0@lo:501: 00000100:00100000:0.0:1789776424.164699:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449487872:12345-0@lo:501: Request processed in 136us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.164707:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789776424.164778:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449487872:0@lo:501: 00000100:00100000:3.0:1789776424.164807:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488000:0@lo:503: 00000100:00100000:3.0:1789776424.164886:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.165038:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.165181:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488000 00000100:00100000:1.0:1789776424.165187:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488000 00000100:00100000:1.0:1789776424.165229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789776424.165237:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449488000:12345-0@lo:503: 00000100:00100000:1.0:1789776424.165334:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449488000:12345-0@lo:503: Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.165354:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789776424.165680:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488000:0@lo:503: 00000100:00100000:3.0:1789776424.166436:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10346:1876716449488128:0@lo:502: 00000100:00100000:3.0:1789776424.166484:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.166542:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.166663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488128 00000100:00100000:1.0:1789776424.166669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488128 00000100:00100000:1.0:1789776424.166701:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789776424.166708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:10346:x1876716449488128:12345-0@lo:502: 00000100:00100000:1.0:1789776424.166820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:10346:x1876716449488128:12345-0@lo:502: Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.166829:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789776424.167214:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10346:1876716449488128:0@lo:502: 00000100:00100000:3.0:1789776424.167266:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10346:1876716449488256:0@lo:502: 00000100:00100000:3.0:1789776424.167302:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.167334:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.167459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488256 00000100:00100000:1.0:1789776424.167464:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488256 00000100:00100000:1.0:1789776424.167518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789776424.167528:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:10346:x1876716449488256:12345-0@lo:502: 00000100:00100000:1.0:1789776424.167609:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:10346:x1876716449488256:12345-0@lo:502: Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.167615:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789776424.167734:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10346:1876716449488256:0@lo:502: 00000040:00080000:3.0:1789776424.167754:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789776424.168050:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789776424.168068:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776424.168078:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.168090:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776424.168100:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789776424.168102:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789776424.168105:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789776424.168131:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.168140:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.168149:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776424.168160:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488384:0@lo:101: 00000100:00100000:1.0:1789776424.168187:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.168258:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.168320:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488384 00000100:00100000:2.0:1789776424.168324:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488384 00000100:00100000:3.0:1789776424.168428:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789776424.168436:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+16:6514:x1876716449488384:12345-0@lo:101: 00010000:00010000:3.0:1789776424.168445:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776424.168457:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256800/0xf13b8042cb8849cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.168479:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256800/0xf13b8042cb8849cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849c6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.168488:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256800/0xf13b8042cb8849cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849c6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.168622:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256800, rc 0) 00000100:00100000:3.0:1789776424.168667:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449488384:12345-0@lo:101: Request processed in 231us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.168680:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789776424.168751:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488384:0@lo:101: 00010000:00010000:0.0:1789776424.168768:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.168782:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.168833:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488512:0@lo:501: 00000100:00100000:0.0:1789776424.168993:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.169032:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.169078:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488512 00000100:00100000:3.0:1789776424.169082:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488512 00000100:00100000:3.0:1789776424.169119:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789776424.169127:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449488512:12345-0@lo:501: 00000100:00100000:3.0:1789776424.169235:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449488512:12345-0@lo:501: Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.169241:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789776424.169437:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488512:0@lo:501: 00000100:00100000:0.0:1789776424.169467:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488640:0@lo:503: 00000100:00100000:0.0:1789776424.169531:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.169557:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.169569:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488640 00000100:00100000:0.0:1789776424.169573:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488640 00000100:00100000:0.0:1789776424.169593:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789776424.169599:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449488640:12345-0@lo:503: 00000100:00100000:0.0:1789776424.169690:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449488640:12345-0@lo:503: Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.169697:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789776424.169737:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449488640:0@lo:503: 00000100:00100000:0.0:1789776424.170077:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10347:1876716449488768:0@lo:502: 00000100:00100000:0.0:1789776424.170111:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.170130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488768 00000100:00100000:0.0:1789776424.170134:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488768 00000100:00100000:0.0:1789776424.170153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789776424.170159:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:10347:x1876716449488768:12345-0@lo:502: 00000100:00100000:1.0:1789776424.170245:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.170404:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:10347:x1876716449488768:12345-0@lo:502: Request processed in 244us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.170412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789776424.170485:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10347:1876716449488768:0@lo:502: 00000020:01000000:1.0:1789776424.170598:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776424.170607:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.170609:0:10347:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776424.170613:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789776424.170634:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10347:1876716449488896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.170663:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.170690:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.170698:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449488896 00000100:00100000:3.0:1789776424.170702:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449488896 00000100:00100000:3.0:1789776424.170732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789776424.170739:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:10347:x1876716449488896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.170803:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:10347:x1876716449488896:12345-0@lo:502:llog_process_th.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.170809:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789776424.170832:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10347:1876716449488896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776424.170915:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776424.170920:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.170921:0:10347:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776424.170925:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789776424.171155:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789776424.171175:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789776424.171184:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.171194:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776424.171203:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789776424.171205:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cfc247800 from 48 10000000:01000000:0.0:1789776424.171208:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776424.171231:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.171239:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.171247:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.171260:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.171289:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.171311:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.171366:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489024 00000100:00100000:2.0:1789776424.171371:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489024 00000100:00100000:2.0:1789776424.171437:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789776424.171444:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+17:6514:x1876716449489024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776424.171452:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776424.171469:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb8849db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.171489:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb8849db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849d4 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.171689:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb8849db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849d4 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.171697:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d200, rc 0) 00000100:00100000:2.0:1789776424.171760:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.171764:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789776424.171809:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776424.171819:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.171829:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.171876:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.171900:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.171928:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.171976:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489152 00000100:00100000:2.0:1789776424.171980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489152 00000100:00100000:2.0:1789776424.172052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789776424.172060:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.172147:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.172153:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789776424.172211:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.172243:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.172276:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.172296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489280 00000100:00100000:0.0:1789776424.172296:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.172300:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489280 00000100:00100000:2.0:1789776424.172332:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789776424.172422:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.172807:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 468us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.172814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789776424.172893:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.173261:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10348:1876716449489408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776424.173303:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.173364:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.173403:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489408 00000100:00100000:1.0:1789776424.173408:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489408 00000100:00100000:1.0:1789776424.173486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789776424.176682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:10348:x1876716449489408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.176871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:10348:x1876716449489408:12345-0@lo:502:llog_process_th.0 Request processed in 3377us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.176881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789776424.177025:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10348:1876716449489408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.177098:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10348:1876716449489536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.177141:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.177553:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.177766:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489536 00000100:00100000:3.0:1789776424.177773:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489536 00000100:00100000:3.0:1789776424.177815:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789776424.177825:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:10348:x1876716449489536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.177919:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:10348:x1876716449489536:12345-0@lo:502:llog_process_th.0 Request processed in 95us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.177926:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789776424.178014:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10348:1876716449489536:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789776424.178067:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789776424.178132:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789776424.178153:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776424.178163:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.178174:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776424.178191:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789776424.178194:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789776424.178197:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776424.178222:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.178230:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.178239:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.178255:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.178285:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.178307:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.178528:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489664 00000100:00100000:3.0:1789776424.178533:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489664 00000100:00100000:3.0:1789776424.178553:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789776424.178559:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+18:6514:x1876716449489664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776424.178575:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776424.178587:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8849e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.178606:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8849e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849e2 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.178616:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8849e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849e2 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.178625:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257c00, rc 0) 00000100:00100000:3.0:1789776424.178658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449489664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.178664:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789776424.178755:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776424.178767:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.178775:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.178822:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.178845:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.178857:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.178898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489792 00000100:00100000:3.0:1789776424.178902:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489792 00000100:00100000:3.0:1789776424.178919:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789776424.178925:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449489792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.179045:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449489792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.179052:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789776424.179119:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.179142:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.179176:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.179194:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.179230:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449489920 00000100:00100000:3.0:1789776424.179234:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449489920 00000100:00100000:3.0:1789776424.179248:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789776424.179253:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449489920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.179330:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449489920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.179346:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789776424.179413:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449489920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.179715:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10349:1876716449490048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.179747:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.179764:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.179795:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490048 00000100:00100000:3.0:1789776424.179798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490048 00000100:00100000:3.0:1789776424.179810:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789776424.179814:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:10349:x1876716449490048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.179884:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:10349:x1876716449490048:12345-0@lo:502:llog_process_th.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.179890:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789776424.180113:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10349:1876716449490048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776424.180131:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776424.180139:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776424.180141:0:10349:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789776424.180145:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789776424.180164:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10349:1876716449490176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.180191:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.180209:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.180357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490176 00000100:00100000:3.0:1789776424.180361:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490176 00000100:00100000:3.0:1789776424.180379:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789776424.180385:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:10349:x1876716449490176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.180459:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:10349:x1876716449490176:12345-0@lo:502:llog_process_th.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.180466:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789776424.182047:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10349:1876716449490176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776424.182080:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776424.182087:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776424.182090:0:10349:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789776424.182094:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789776424.182470:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789776424.182518:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789776424.182529:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.182541:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776424.182552:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776424.182554:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cd0f5c800 from 48 10000000:01000000:3.0:1789776424.182557:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776424.182592:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.182608:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.182617:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.182636:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.182696:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.182724:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.182787:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490304 00000100:00100000:0.0:1789776424.182794:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490304 00000100:00100000:0.0:1789776424.182828:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789776424.182836:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:6514:x1876716449490304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776424.182847:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776424.182860:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb8849f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.182900:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb8849f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849f0 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.182913:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb8849f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849f0 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.182922:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc3bf0e00, rc 0) 00000100:00100000:0.0:1789776424.182968:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.182976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789776424.182990:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776424.183022:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.183032:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776424.183090:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776424.183118:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.183159:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.183647:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490432 00000100:00100000:2.0:1789776424.183653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490432 00000100:00100000:2.0:1789776424.183693:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789776424.183700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.183810:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.183816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789776424.184189:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776424.184224:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776424.184345:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.184374:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.184414:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490560 00000100:00100000:0.0:1789776424.184420:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490560 00000100:00100000:0.0:1789776424.184458:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789776424.184467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.184631:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.184640:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789776424.184657:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776424.185248:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10350:1876716449490688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.185287:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.185318:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.185367:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490688 00000100:00100000:0.0:1789776424.185373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490688 00000100:00100000:0.0:1789776424.185442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789776424.185451:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:10350:x1876716449490688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.185577:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:10350:x1876716449490688:12345-0@lo:502:llog_process_th.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.185584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789776424.185672:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10350:1876716449490688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.185710:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10350:1876716449490816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.185741:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.188420:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.190306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490816 00000100:00100000:3.0:1789776424.190319:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490816 00000100:00100000:3.0:1789776424.190392:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789776424.190404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:10350:x1876716449490816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.190595:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:10350:x1876716449490816:12345-0@lo:502:llog_process_th.0 Request processed in 193us (4852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.190603:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789776424.190860:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10350:1876716449490816:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789776424.191297:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789776424.191588:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789776424.191612:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776424.191623:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.191634:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776424.191644:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789776424.191647:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789776424.191650:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789776424.191693:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.191702:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.191712:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.191735:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.194013:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.194072:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.194178:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449490944 00000100:00100000:0.0:1789776424.194187:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449490944 00000100:00100000:0.0:1789776424.194253:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789776424.194263:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449490944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776424.194280:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776424.194296:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc3bf0000/0xf13b8042cb884a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb8849fe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.194325:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc3bf0000/0xf13b8042cb884a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb8849fe expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.194336:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc3bf0000/0xf13b8042cb884a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8849fe expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.194357:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc3bf0000, rc 0) 00000100:00100000:0.0:1789776424.194405:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449490944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.194412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789776424.195703:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449490944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776424.195729:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.195747:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.195834:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.195877:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.197011:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.202682:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491072 00000100:00100000:1.0:1789776424.202699:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491072 00000100:00100000:0.0:1789776424.205692:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789776424.205707:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449491072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.205901:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449491072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (10023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.205909:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789776424.206028:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.206079:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.206136:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.206174:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.206422:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491200 00000100:00100000:2.0:1789776424.206429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491200 00000100:00100000:2.0:1789776424.206480:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789776424.206488:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449491200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.206626:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449491200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.206634:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789776424.206897:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.208158:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10351:1876716449491328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776424.208224:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.208263:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.208336:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491328 00000100:00100000:0.0:1789776424.208343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491328 00000100:00100000:0.0:1789776424.208386:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789776424.208395:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10351:x1876716449491328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.208671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10351:x1876716449491328:12345-0@lo:502:llog_process_th.0 Request processed in 277us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.208689:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789776424.208740:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10351:1876716449491328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776424.208769:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776424.208778:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.208780:0:10351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776424.208785:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789776424.208809:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10351:1876716449491456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.208850:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.208882:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.209028:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491456 00000100:00100000:0.0:1789776424.209033:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491456 00000100:00100000:0.0:1789776424.209066:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789776424.209073:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10351:x1876716449491456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.209155:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10351:x1876716449491456:12345-0@lo:502:llog_process_th.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.209162:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789776424.209354:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10351:1876716449491456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776424.209380:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776424.209385:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.209387:0:10351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776424.209391:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789776424.209770:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789776424.209792:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789776424.209801:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.209813:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776424.209823:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789776424.209826:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5cdb443800 from 48 10000000:01000000:0.0:1789776424.209829:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776424.209853:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.209860:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.209869:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.209883:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.209922:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.209954:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776424.210031:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491584 00000100:00100000:1.0:1789776424.210037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491584 00000100:00100000:1.0:1789776424.210076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789776424.210084:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449491584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776424.210095:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776424.210109:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb884a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.210132:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb884a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a0c expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.210149:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb884a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a0c expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.210158:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1c00, rc 0) 00000100:00100000:1.0:1789776424.213078:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449491584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2984us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.213091:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789776424.213688:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776424.213727:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.213740:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776424.213894:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.213945:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.213985:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.214033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491712 00000100:00100000:0.0:1789776424.214040:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491712 00000100:00100000:0.0:1789776424.214087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789776424.214097:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449491712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.214232:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449491712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.214239:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789776424.214291:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.214321:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.214361:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.214392:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.214444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491840 00000100:00100000:0.0:1789776424.214448:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491840 00000100:00100000:0.0:1789776424.214477:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789776424.214484:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449491840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.214637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449491840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.214644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789776424.215119:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449491840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.215598:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10352:1876716449491968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.215646:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.215680:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.216033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449491968 00000100:00100000:0.0:1789776424.216039:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449491968 00000100:00100000:0.0:1789776424.216080:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789776424.216089:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10352:x1876716449491968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.216201:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10352:x1876716449491968:12345-0@lo:502:llog_process_th.0 Request processed in 112us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.216209:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789776424.217803:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10352:1876716449491968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776424.217937:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10352:1876716449492096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776424.218006:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776424.218047:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.218107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492096 00000100:00100000:0.0:1789776424.218114:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492096 00000100:00100000:0.0:1789776424.218160:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789776424.218169:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10352:x1876716449492096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.218421:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10352:x1876716449492096:12345-0@lo:502:llog_process_th.0 Request processed in 252us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.218429:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789776424.218521:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10352:1876716449492096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789776424.218602:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789776424.219074:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789776424.219096:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776424.219106:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.219118:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776424.219128:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789776424.219131:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789776424.219134:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776424.219160:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.219168:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.219177:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776424.219194:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.219228:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.219260:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.219309:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492224 00000100:00100000:2.0:1789776424.219314:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492224 00000100:00100000:2.0:1789776424.219390:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789776424.219398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449492224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776424.219408:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776424.219420:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342de00/0xf13b8042cb884a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.219440:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342de00/0xf13b8042cb884a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a1a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.219450:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342de00/0xf13b8042cb884a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a1a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.219458:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342de00, rc 0) 00000100:00100000:2.0:1789776424.219546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.219552:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789776424.226371:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776424.226613:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.226628:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.226810:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.226876:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.226923:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.226971:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492352 00000100:00100000:0.0:1789776424.226978:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492352 00000100:00100000:0.0:1789776424.227047:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789776424.227072:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.227215:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.227224:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789776424.227393:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.227425:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.227464:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.227518:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.227624:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492480 00000100:00100000:2.0:1789776424.227629:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492480 00000100:00100000:2.0:1789776424.227666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789776424.227674:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776424.227780:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.227788:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789776424.228076:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.228463:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10353:1876716449492608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.228541:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.228566:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776424.229060:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492608 00000100:00100000:0.0:1789776424.229066:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492608 00000100:00100000:0.0:1789776424.229107:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789776424.229114:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10353:x1876716449492608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776424.229242:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10353:x1876716449492608:12345-0@lo:502:llog_process_th.0 Request processed in 127us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.229248:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789776424.229372:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10353:1876716449492608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776424.229399:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776424.229409:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.229411:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776424.229417:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789776424.229443:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10353:1876716449492736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776424.229485:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776424.229558:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.229608:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492736 00000100:00100000:3.0:1789776424.229612:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492736 00000100:00100000:3.0:1789776424.229632:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789776424.229639:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10353:x1876716449492736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776424.229735:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10353:x1876716449492736:12345-0@lo:502:llog_process_th.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.229741:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789776424.229923:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10353:1876716449492736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776424.229943:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776424.229947:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776424.229948:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776424.229952:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789776424.230116:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1789776424.230136:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789776424.230147:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.230159:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776424.230170:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789776424.230174:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5cc8c63370 from 1 10000000:01000000:3.0:1789776424.230177:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789776424.230268:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.230276:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.230298:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.230314:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.230346:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776424.230373:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776424.230424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492864 00000100:00100000:2.0:1789776424.230429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492864 00000100:00100000:2.0:1789776424.230515:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789776424.230523:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449492864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776424.230533:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776424.230547:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342d800/0xf13b8042cb884a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.230571:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342d800/0xf13b8042cb884a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a28 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.230581:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342d800/0xf13b8042cb884a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a28 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.230590:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d800, rc 0) 00000100:00100000:2.0:1789776424.230630:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449492864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.230636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789776424.230708:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776424.230720:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776424.230729:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776424.230778:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.230862:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776424.230889:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776424.230916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449492992 00000100:00100000:3.0:1789776424.230920:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449492992 00000100:00100000:3.0:1789776424.230952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789776424.230959:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449492992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776424.231046:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449492992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776424.231054:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789776424.231122:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449492992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789776424.231143:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789776424.231149:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776424.231156:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776424.355137:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776424.826622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776424.826874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432659968 00000100:00100000:2.0:1789776424.826884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432659968 00000100:00100000:2.0:1789776424.827247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:2.0:1789776424.827259:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:6182:x1876716432659968:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1789776424.827275:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776424.827292:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342c800/0xf13b8042cb884a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab567e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.827334:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342c800/0xf13b8042cb884a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab567e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.827346:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342c800/0xf13b8042cb884a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab567e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.827356:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c800, rc 0) 00000100:00100000:2.0:1789776424.828325:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432659968:12345-192.168.204.27@tcp:101: Request processed in 1062us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.828334:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:3.0:1789776424.839125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776424.839457:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660096 00000100:00100000:0.0:1789776424.839468:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660096 00000100:00100000:0.0:1789776424.839547:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:0.0:1789776424.839558:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660096:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1789776424.839710:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660096:12345-192.168.204.27@tcp:501: Request processed in 152us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.839733:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:0.0:1789776424.842383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776424.843450:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660224 00000100:00100000:2.0:1789776424.843462:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660224 00000100:00100000:2.0:1789776424.843542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:2.0:1789776424.843552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660224:12345-192.168.204.27@tcp:503: 00000100:00100000:2.0:1789776424.843696:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660224:12345-192.168.204.27@tcp:503: Request processed in 145us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.843705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:1.0:1789776424.854685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776424.854789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660352 00000100:00100000:0.0:1789776424.854799:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660352 00000100:00100000:0.0:1789776424.854860:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:0.0:1789776424.854870:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6661:x1876716432660352:12345-192.168.204.27@tcp:502: 00000100:00100000:0.0:1789776424.855053:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6661:x1876716432660352:12345-192.168.204.27@tcp:502: Request processed in 184us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776424.855061:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:3.0:1789776424.857929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776424.858039:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660480 00000100:00100000:1.0:1789776424.858050:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660480 00000100:00100000:1.0:1789776424.858108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1789776424.858118:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6661:x1876716432660480:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789776424.858283:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6661:x1876716432660480:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.858291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1789776424.861558:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776424.861816:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660608 00000100:00100000:2.0:1789776424.861826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660608 00000100:00100000:2.0:1789776424.861884:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1789776424.861965:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660608:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776424.863482:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776424.863525:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342c200/0xf13b8042cb884a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5685 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.863562:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342c200/0xf13b8042cb884a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5685 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.863591:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342c200/0xf13b8042cb884a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5685 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776424.863600:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c200, rc 0) 00000100:00100000:2.0:1789776424.863674:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432660608:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 1781us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776424.863684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1789776424.872736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776424.872888:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660736 00000100:00100000:0.0:1789776424.872908:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660736 00000100:00100000:0.0:1789776424.872963:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1789776424.872973:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432660736:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776424.873111:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432660736:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 139us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776424.873118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00010000:00010000:0.0:1789776425.386136:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776425.506924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776425.507007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776425.507065:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493120 00000100:00100000:0.0:1789776425.507072:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493120 00000100:00100000:0.0:1789776425.507129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776425.507153:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449493120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776425.507184:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776425.507228:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449493120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776425.507246:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789776425.507268:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776425.507867:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b6680 x1876716449493120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776425.507889:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776425.508686:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776425.508699:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449493248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776425.508747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776425.508786:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493248 00000100:00100000:2.0:1789776425.508791:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493248 00000100:00100000:2.0:1789776425.508834:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776425.508842:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449493248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776425.508858:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776425.508895:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449493248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776425.508914:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789776425.508946:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43e680 x1876716449493248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776425.508960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449493248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776425.509659:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776426.018686:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449493376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776426.018774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.018831:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493376 00000100:00100000:1.0:1789776426.018839:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493376 00000100:00100000:1.0:1789776426.018895:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776426.018904:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449493376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776426.018933:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776426.018987:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449493376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.019014:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789776426.019047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789776426.019075:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e09500 x1876716449493376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776426.019104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449493376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776426.019550:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776426.019560:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449493504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776426.019589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.019613:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493504 00000100:00100000:0.0:1789776426.019617:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493504 00000100:00100000:0.0:1789776426.019643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776426.019650:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449493504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776426.019662:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776426.019689:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449493504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.019694:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789776426.019719:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789776426.019735:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b6680 x1876716449493504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776426.019747:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449493504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776426.020912:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449493760:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.020955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.020992:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449494272:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.021097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449494784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.021135:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789776426.021141:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449493888:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.021178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449494400:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.021213:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449494912:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.021252:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493760 00000100:00100000:1.0:1789776426.021257:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493760 00000100:00100000:1.0:1789776426.021284:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494272 00000100:00100000:1.0:1789776426.021287:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494272 00000100:00100000:1.0:1789776426.021303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494784 00000100:00100000:1.0:1789776426.021306:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494784 00000100:00100000:1.0:1789776426.021316:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494400 00000100:00100000:1.0:1789776426.021324:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494400 00000100:00100000:1.0:1789776426.021338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494912 00000100:00100000:1.0:1789776426.021341:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494912 00000100:00100000:1.0:1789776426.021356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789776426.021362:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449493760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021402:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449493760:12345-0@lo:400:kworker.0 Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.021409:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789776426.021432:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776426.021437:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449494272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021458:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449494272:12345-0@lo:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.021463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776426.021474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789776426.021479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449494784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021524:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449494784:12345-0@lo:400:kworker.0 Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.021529:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789776426.021541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776426.021547:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449494400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021571:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449494400:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.021576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776426.021588:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789776426.021593:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449494912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.021615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449494912:12345-0@lo:400:kworker.0 Request processed in 22us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.021626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789776426.021650:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.023286:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493888 00000100:00100000:0.0:1789776426.023298:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493888 00000100:00100000:0.0:1789776426.023346:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776426.023356:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.024873:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449493888:12345-0@lo:400:kworker.0 Request processed in 1513us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.024891:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789776426.024947:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776426.024952:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776426.024979:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449493632:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.025070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.025112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449494528:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.025143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.025202:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449493888:0@lo:400:kworker.0 00010000:00080000:1.0:1789776426.025219:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e09500 x1876716449494400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776426.025229:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449494400:0@lo:400:kworker.0 00010000:00080000:1.0:1789776426.025241:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43a300 x1876716449494912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776426.025248:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449494912:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.025260:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449493760:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.025272:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449494272:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.025283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449494784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.028895:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494528 00000100:00100000:1.0:1789776426.028910:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494528 00000100:00100000:1.0:1789776426.028975:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776426.028986:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776426.030027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494016 00000100:00100000:2.0:1789776426.030036:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494016 00000100:00100000:2.0:1789776426.030101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776426.030125:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449494016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776426.030216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449494016:12345-0@lo:400:kworker.0 Request processed in 93us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.030224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776426.030827:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449494528:12345-0@lo:400:kworker.0 Request processed in 1842us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.030837:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776426.030920:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449494016:0@lo:400:kworker.0 00010000:00080000:1.0:1789776426.030934:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43ad80 x1876716449494528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776426.030944:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449494528:0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.033882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.033935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.033982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.034008:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449494656:0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.034034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.034216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494144 00000100:00100000:0.0:1789776426.034224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494144 00000100:00100000:0.0:1789776426.034267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776426.034276:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.034333:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449494144:12345-0@lo:400:kworker.0 Request processed in 58us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.034341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776426.034364:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449494656 00000100:00100000:0.0:1789776426.034368:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449494656 00000100:00100000:0.0:1789776426.034393:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776426.034400:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449494656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776426.034428:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449494656:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.034434:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776426.034469:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449494144:0@lo:400:kworker.0 00010000:00080000:0.0:1789776426.034482:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff438a80 x1876716449494656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776426.034522:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449494656:0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.036554:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449493632 00000100:00100000:1.0:1789776426.036565:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449493632 00000100:00100000:1.0:1789776426.036618:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789776426.036903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449493632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776426.037011:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449493632:12345-0@lo:400:kworker.0 Request processed in 111us (3134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.037019:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789776426.037213:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449493632:0@lo:400:kworker.0 00000020:00000080:1.0:1789776426.056167:0:10391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe336ef440 20000000:00000080:1.0:1789776426.056183:0:10391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5bc35bc400 uarg=0000000000000000 20000000:01000000:1.0:1789776426.056224:0:10391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789776426.056230:0:10391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789776426.056234:0:10391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789776426.056893:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789776426.057100:0:10391:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789776426.063097:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789776426.063136:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789776426.063153:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789776426.063182:0:10391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789776426.063201:0:10391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063220:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063229:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063251:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb88473b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063258:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884861 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063267:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063275:0:10391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063315:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063331:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 9 pid: 6510 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.063347:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495040:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776426.063542:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063552:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.063562:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495168:0@lo:104: 00000100:00100000:1.0:1789776426.063602:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776426.063649:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063664:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.063673:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495296:0@lo:104: 00000100:00100000:1.0:1789776426.063708:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.063741:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789776426.063752:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495168 00000100:00100000:1.0:1789776426.063758:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495168 00000100:00100000:1.0:1789776426.063793:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495296 00000100:00100000:1.0:1789776426.063796:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495296 00000100:00100000:1.0:1789776426.063811:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789776426.063820:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:10391:x1876716449495168:12345-0@lo:104: 00010000:00010000:1.0:1789776426.063832:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063879:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776426.063885:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:10391:x1876716449495168:12345-0@lo:104: Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.063892:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789776426.063912:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789776426.063918:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495296:12345-0@lo:104: 00010000:00010000:1.0:1789776426.063925:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.063956:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776426.063972:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495296:12345-0@lo:104: Request processed in 44us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.063987:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789776426.064090:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776426.064097:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064104:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776426.064108:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064117:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776426.064124:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776426.064130:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776426.064156:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064163:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776426.064183:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064190:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fc00/0xf13b8042cb884861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884868 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064202:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776426.064206:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064223:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776426.064226:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064232:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776426.064238:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776426.064243:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776426.064257:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064263:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776426.064269:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064276:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb88473b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884742 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064284:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776426.064286:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776426.064288:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776426.064294:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776426.064305:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449495424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776426.064333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.064358:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776426.064364:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449495552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776426.064394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776426.064431:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064440:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 23 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.064449:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495680:0@lo:104: 00000100:00100000:1.0:1789776426.064469:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.064487:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495680 00000100:00100000:1.0:1789776426.064517:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495680 00000100:00100000:1.0:1789776426.064538:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776426.064544:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495680:12345-0@lo:104: 00010000:00010000:1.0:1789776426.064551:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064580:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776426.064585:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495680:12345-0@lo:104: Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.064590:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789776426.064620:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064628:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 23 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.064637:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495808:0@lo:104: 00000100:00100000:1.0:1789776426.064657:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.064675:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495808 00000100:00100000:1.0:1789776426.064684:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495808 00000100:00100000:1.0:1789776426.064700:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776426.064705:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495808:12345-0@lo:104: 00010000:00010000:1.0:1789776426.064712:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064739:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776426.064744:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:10391:x1876716449495808:12345-0@lo:104: Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776426.064750:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789776426.064765:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776426.064769:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064776:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d02044000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776426.064779:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064786:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776426.064793:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776426.064797:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776426.064824:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064830:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776426.064843:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064855:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d02044000/0xf13b8042cb8846e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064866:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776426.064868:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064874:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d02045400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776426.064877:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064884:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776426.064891:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776426.064896:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776426.064909:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064915:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776426.064921:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064927:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d02045400/0xf13b8042cb8846cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb8846d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.064938:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776426.064945:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776426.064947:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776426.064958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449495936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776426.065229:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776426.065269:0:10391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.065563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495424 00000100:00100000:2.0:1789776426.065569:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495424 00010000:00010000:2.0:1789776426.065592:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 24 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.065624:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495552 00000100:00100000:2.0:1789776426.065627:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495552 00010000:00010000:2.0:1789776426.065638:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 25 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.065656:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776426.065663:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3645:x1876716449495424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776426.065674:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776426.065680:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 25 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.065690:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 25 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.065717:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776426.066042:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884861 expref: 25 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.066054:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495168:0@lo:104: 00000100:00100000:0.0:1789776426.066067:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495296:0@lo:104: 00000100:00100000:0.0:1789776426.066074:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495680:0@lo:104: 00000100:00100000:0.0:1789776426.066095:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495808:0@lo:104: 00000100:00100000:0.0:1789776426.066123:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449496064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776426.066159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.066469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.066566:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496064 00000100:00100000:0.0:1789776426.066571:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496064 00010000:00010000:0.0:1789776426.066591:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 25 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.066606:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449495936 00000100:00100000:0.0:1789776426.066609:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449495936 00010000:00010000:0.0:1789776426.066619:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 26 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.066631:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776426.066637:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+26:3645:x1876716449495552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776426.066646:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776426.066661:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 26 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066671:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 26 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066682:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030e00/0xf13b8042cb884742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb88473b expref: 26 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066692:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776426.066740:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3645:x1876716449495552:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.066747:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776426.066762:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789776426.066768:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449496064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776426.066775:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776426.066779:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 24 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066787:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 24 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066796:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0031400/0xf13b8042cb8846d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8846cb expref: 24 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066805:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776426.066833:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3644:x1876716449496064:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.066838:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789776426.066852:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776426.066865:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3643:x1876716449495936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776426.066873:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776426.066877:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 22 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066885:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 22 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066895:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d02045e00/0xf13b8042cb8846ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb8846e7 expref: 22 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.066904:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776426.066930:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449495936:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.066936:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776426.066977:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449496064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776426.067172:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449495552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776426.067198:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449495936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776426.071686:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3645:x1876716449495424:12345-0@lo:103:ldlm_bl.0 Request processed in 6009us (7337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.071714:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776426.072272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449495424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776426.072810:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1876716449495040:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776426.072844:0:10391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776426.072980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776426.073152:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660864 00000100:00100000:0.0:1789776426.073159:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660864 00010000:00010000:0.0:1789776426.073190:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.073222:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1789776426.073231:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432660864:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776426.073244:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776426.073263:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073275:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073293:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884980 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5646 expref: 10 pid: 6510 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073310:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073317:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073332:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073339:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073346:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073352:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073358:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776426.073362:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073371:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073400:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.073411:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776426.073569:0:10391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.073583:0:10391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.073589:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb884a44 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.084650:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:2412:x1876716432660864:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 11408us (11660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.084664:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 10000000:01000000:0.0:1789776426.162588:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776426.162596:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc1a65000 from 4 10000000:01000000:0.0:1789776426.162601:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776426.162649:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.162663:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776426.162674:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776426.162701:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776426.162772:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776426.162824:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.162917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496192 00000100:00100000:2.0:1789776426.162925:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496192 00000100:00100000:2.0:1789776426.162999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789776426.163010:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449496192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.163025:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776426.163039:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.163061:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.163071:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.163078:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ca00, rc 0) 00000100:00100000:2.0:1789776426.163123:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.163129:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789776426.163327:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776426.163343:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.163352:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776426.163414:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776426.163441:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.163466:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.163524:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496320 00000100:00100000:2.0:1789776426.163528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496320 00000100:00100000:2.0:1789776426.163559:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789776426.163566:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.163675:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.163682:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789776426.163710:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.163736:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.163772:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.163792:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.163803:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496448 00000100:00100000:2.0:1789776426.163807:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496448 00000100:00100000:2.0:1789776426.163828:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789776426.163833:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.163905:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.163911:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789776426.163944:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.164188:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10399:1876716449496576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.164225:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.164244:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496576 00000100:00100000:2.0:1789776426.164248:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496576 00000100:00100000:2.0:1789776426.164268:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789776426.164274:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10399:x1876716449496576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.164343:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10399:x1876716449496576:12345-0@lo:502:llog_process_th.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.164350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789776426.164384:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.164395:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10399:1876716449496576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.164412:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776426.164420:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.164422:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776426.164427:0:10399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc1a65000 00000020:00000080:2.0:1789776426.164429:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776426.167129:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10399:1876716449496704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.167206:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.167259:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508600 going to sleep for 11 seconds 00000100:00100000:0.0:1789776426.168274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496704 00000100:00100000:0.0:1789776426.168284:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496704 00000100:00100000:0.0:1789776426.168340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789776426.168349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10399:x1876716449496704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776426.168477:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:10399:x1876716449496704:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.168526:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789776426.181553:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10399:1876716449496704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.181597:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776426.181606:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.181609:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789776426.181613:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789776426.181683:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789776426.181709:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776426.181719:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.181730:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776426.181740:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776426.181742:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cfc247800 from 4 10000000:01000000:2.0:1789776426.181745:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776426.181777:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.181786:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.181802:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.181821:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.181883:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.181921:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7faea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.181939:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496832 00000100:00100000:2.0:1789776426.181944:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496832 00000100:00100000:2.0:1789776426.182010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789776426.182019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449496832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.182031:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776426.182044:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a59 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.182065:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.182075:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.182083:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d400, rc 0) 00000100:00100000:2.0:1789776426.182118:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449496832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.182125:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789776426.182163:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.182176:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.182191:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.182241:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.182267:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.182281:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7faea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.182293:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449496960 00000100:00100000:2.0:1789776426.182296:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449496960 00000100:00100000:2.0:1789776426.182317:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789776426.182322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449496960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.182419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449496960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.182426:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789776426.182456:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449496960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.182482:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.182543:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.182557:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dcae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.182570:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497088 00000100:00100000:2.0:1789776426.182573:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497088 00000100:00100000:2.0:1789776426.182589:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789776426.182594:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449497088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.182667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449497088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.182673:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789776426.182717:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.186321:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10403:1876716449497216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.186401:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.186440:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497216 00000100:00100000:2.0:1789776426.186445:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497216 00000100:00100000:2.0:1789776426.186487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789776426.186511:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10403:x1876716449497216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.186614:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10403:x1876716449497216:12345-0@lo:502:llog_process_th.0 Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.186623:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789776426.186672:0:10403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.186692:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10403:1876716449497216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.186721:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776426.186732:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.186734:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776426.186741:0:10403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cfc247800 00000020:00000080:2.0:1789776426.186744:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776426.192802:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10403:1876716449497344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.192891:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.192940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497344 00000100:00100000:2.0:1789776426.192946:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497344 00000100:00100000:2.0:1789776426.193015:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789776426.193025:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10403:x1876716449497344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.193132:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:10403:x1876716449497344:12345-0@lo:502:llog_process_th.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.193140:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789776426.193197:0:10403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.193217:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10403:1876716449497344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.193244:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776426.193251:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.193253:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789776426.193258:0:10403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789776426.193316:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789776426.193337:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776426.193348:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193358:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776426.193368:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776426.193370:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cd0f5c800 from 4 10000000:01000000:2.0:1789776426.193373:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776426.193395:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193403:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193411:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.193422:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.193447:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.193461:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.193474:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497472 00000100:00100000:2.0:1789776426.193482:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497472 00000100:00100000:2.0:1789776426.193541:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789776426.193549:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449497472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.193557:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776426.193570:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193590:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193600:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193607:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ce00, rc 0) 00000100:00100000:2.0:1789776426.193636:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449497472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.193642:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789776426.193668:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.193679:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.193687:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.193730:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.193752:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.193764:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.193775:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497600 00000100:00100000:2.0:1789776426.193783:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497600 00000100:00100000:2.0:1789776426.193806:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789776426.193811:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449497600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.193897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449497600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.193904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789776426.193931:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.193954:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.193999:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.194011:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.194022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497728 00000100:00100000:2.0:1789776426.194026:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497728 00000100:00100000:2.0:1789776426.194045:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789776426.194050:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449497728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.194110:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449497728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.194116:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789776426.194150:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449497728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776426.196116:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10405:1876716449497856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776426.196186:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.196229:0:10405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.196340:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497856 00000100:00100000:2.0:1789776426.196347:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497856 00000100:00100000:2.0:1789776426.196386:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789776426.196394:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10405:x1876716449497856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.196534:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10405:x1876716449497856:12345-0@lo:502:llog_process_th.0 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.196541:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789776426.196642:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10405:1876716449497856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776426.196672:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776426.196680:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776426.196682:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789776426.196688:0:10405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cd0f5c800 00000020:00000080:1.0:1789776426.196696:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776426.196785:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10405:1876716449497984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776426.196816:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776426.196833:0:10405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34fb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.196935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449497984 00000100:00100000:2.0:1789776426.196940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449497984 00000100:00100000:2.0:1789776426.196975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789776426.196982:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10405:x1876716449497984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.197124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:10405:x1876716449497984:12345-0@lo:502:llog_process_th.0 Request processed in 141us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.197131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789776426.197553:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10405:1876716449497984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776426.197575:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776426.197580:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776426.197582:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789776426.197585:0:10405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789776426.197769:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789776426.197794:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776426.197804:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.197816:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776426.197827:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776426.197829:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cdb443800 from 4 10000000:01000000:2.0:1789776426.197832:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776426.198942:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.198956:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.198974:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.199084:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199138:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.199183:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.199206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498112 00000100:00100000:2.0:1789776426.199212:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498112 00000100:00100000:2.0:1789776426.199251:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789776426.199258:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449498112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.199270:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776426.199281:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884a75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.199302:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.199313:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.199321:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342cc00, rc 0) 00000100:00100000:2.0:1789776426.199350:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449498112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.199356:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789776426.199392:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776426.199405:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.199414:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776426.199464:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199485:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.199521:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7faea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.199533:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498240 00000100:00100000:2.0:1789776426.199537:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498240 00000100:00100000:2.0:1789776426.199558:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789776426.199564:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449498240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199656:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449498240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.199662:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789776426.199690:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199714:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199748:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.199761:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7faea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.199773:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498368 00000100:00100000:2.0:1789776426.199776:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498368 00000100:00100000:2.0:1789776426.199797:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789776426.199803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449498368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.199888:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449498368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.199894:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789776426.199932:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449498368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.200308:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10406:1876716449498496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.200343:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.200363:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498496 00000100:00100000:2.0:1789776426.200367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498496 00000100:00100000:2.0:1789776426.200389:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789776426.200394:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:10406:x1876716449498496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.200456:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:10406:x1876716449498496:12345-0@lo:502:llog_process_th.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.200463:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789776426.200489:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc900cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.200520:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10406:1876716449498496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.200540:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776426.200548:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.200550:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776426.200556:0:10406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5cdb443800 00000020:00000080:2.0:1789776426.200558:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776426.204302:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10406:1876716449498624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.204383:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776426.204427:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498624 00000100:00100000:2.0:1789776426.204433:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498624 00000100:00100000:2.0:1789776426.204479:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789776426.204488:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:10406:x1876716449498624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776426.205982:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:10406:x1876716449498624:12345-0@lo:502:llog_process_th.0 Request processed in 1490us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.206048:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789776426.206109:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc900cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776426.206132:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:10406:1876716449498624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776426.206165:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776426.206172:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776426.206175:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789776426.206179:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789776426.206246:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789776426.206272:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776426.206281:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776426.206290:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776426.403048:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776426.442209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776426.442333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432660992 00000100:00100000:3.0:1789776426.442354:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432660992 00000100:00100000:3.0:1789776426.442416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 269 00000100:00100000:3.0:1789776426.442426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:6182:x1876716432660992:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776426.442445:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776426.442463:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab568c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776426.442522:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776426.442533:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776426.442543:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257000, rc 0) 00000100:00100000:3.0:1789776426.442709:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432660992:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 283us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776426.442716:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 269 00000100:00100000:1.0:1789776426.445420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776426.445484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661120 00000100:00100000:2.0:1789776426.445532:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661120 00000100:00100000:2.0:1789776426.445586:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 270 00000100:00100000:2.0:1789776426.445596:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432661120:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776426.445728:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432661120:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 134us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776426.445735:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 270 00000100:00100000:0.0:1789776426.449173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776426.453321:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661248 00000100:00100000:3.0:1789776426.453338:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661248 00000100:00100000:3.0:1789776426.453426:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 271 00000100:00100000:3.0:1789776426.453437:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432661248:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776426.453622:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6182:x1876716432661248:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 185us (4516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776426.455044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 271 00000100:00100000:1.0:1789776426.464114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776426.464344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661376 00000100:00100000:0.0:1789776426.464355:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661376 00000100:00100000:0.0:1789776426.464422:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00100000:0.0:1789776426.464433:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6718:x1876716432661376:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776426.464641:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6718:x1876716432661376:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 195us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776426.464650:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00100000:1.0:1789776426.471015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776426.471121:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661504 00000100:00100000:3.0:1789776426.471132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661504 00000100:00100000:3.0:1789776426.471242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 273 00000100:00100000:3.0:1789776426.471252:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6718:x1876716432661504:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776426.471413:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:6718:x1876716432661504:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 163us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776426.471422:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 273 00010000:00010000:1.0:1789776427.428950:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776428.451306:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776429.090772:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776429.090805:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449498752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776429.090923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776429.091068:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498752 00000100:00100000:2.0:1789776429.091150:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498752 00000100:00100000:2.0:1789776429.091733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789776429.091748:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449498752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776429.091805:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776429.091886:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449498752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776429.091894:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776429.097992:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449498880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776429.098251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776429.098397:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449498752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776429.098529:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449498880 00000100:00100000:2.0:1789776429.098539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449498880 00000100:00100000:2.0:1789776429.098595:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789776429.098606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449498880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776429.098671:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776429.098734:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449498880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776429.098743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789776429.098829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449498880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776429.244233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776429.244314:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661632 00000100:00100000:0.0:1789776429.244333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661632 00000100:00100000:3.0:1789776429.244354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776429.244397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776429.244442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 274 00000100:00100000:3.0:1789776429.244443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776429.244469:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2414:x1876716432661632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776429.244483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776429.244567:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661888 00000100:00100000:3.0:1789776429.244579:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661888 00000100:00100000:0.0:1789776429.244641:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2414:x1876716432661632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 177us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776429.244652:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 274 00000100:00100000:3.0:1789776429.244660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432661760 00000100:00100000:3.0:1789776429.244665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432661760 00000100:00100000:3.0:1789776429.244700:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1789776429.244714:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432661888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776429.244732:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1789776429.244746:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432661760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776429.244799:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432661760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 58us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776429.244813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432661888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776429.244826:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:3.0:1789776429.244839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00080000:0.0:1789776429.244869:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776429.244879:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776429.244885:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662144 00000100:00100000:0.0:1789776429.245680:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662016 00000100:00100000:0.0:1789776429.245702:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662016 00000100:00100000:0.0:1789776429.245806:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1789776429.245815:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432662016:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776429.245867:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432662016:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 52us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776429.245876:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1789776429.247209:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662144 00000100:00080000:1.0:1789776429.249105:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776429.249118:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776429.250169:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1789776429.250192:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432662144:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776429.250320:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432662144:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 138us (5921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776429.250329:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:1.0:1789776429.475815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776430.499759:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776430.626740:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449499008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776430.626827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.626926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499008 00000100:00100000:2.0:1789776430.626934:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499008 00000100:00100000:2.0:1789776430.626990:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776430.627000:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449499008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776430.627030:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776430.627077:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449499008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.627084:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789776430.627103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776430.627132:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43ed80 x1876716449499008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776430.627148:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449499008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776430.632451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449499136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776430.632745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.632839:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499136 00000100:00100000:2.0:1789776430.632847:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499136 00000100:00100000:2.0:1789776430.633020:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776430.633029:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449499136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776430.633050:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776430.633088:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449499136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.633095:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789776430.633131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b6300 x1876716449499136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776430.633151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449499136:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789776430.633173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776431.139334:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449499264:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449499776:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139532:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500288:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139617:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500800:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139666:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789776431.139672:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449499392:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449499904:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449500416:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139811:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449499520:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449500032:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139893:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449500544:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139924:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139935:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789776431.139940:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449499648:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139959:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.139969:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449500160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.139986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.140005:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449500672:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.140056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499776 00000100:00100000:2.0:1789776431.140065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499776 00000100:00100000:2.0:1789776431.140108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499520 00000100:00100000:2.0:1789776431.140111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499520 00000100:00100000:2.0:1789776431.140129:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776431.140137:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449499776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140190:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449499776:12345-0@lo:400:kworker.0 Request processed in 53us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776431.140221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776431.140226:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449499520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140260:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449499520:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140265:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776431.140284:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500288 00000100:00100000:2.0:1789776431.140287:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500288 00000100:00100000:2.0:1789776431.140306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500800 00000100:00100000:2.0:1789776431.140309:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500800 00000100:00100000:2.0:1789776431.140330:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500160 00000100:00100000:2.0:1789776431.140332:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500160 00000100:00100000:2.0:1789776431.140342:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500672 00000100:00100000:2.0:1789776431.140344:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500672 00000100:00100000:2.0:1789776431.140358:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776431.140364:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140406:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500288:12345-0@lo:400:kworker.0 Request processed in 42us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140412:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776431.140424:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776431.140431:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140458:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500800:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140464:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776431.140476:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776431.140481:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449500160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140529:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449500160:12345-0@lo:400:kworker.0 Request processed in 47us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140545:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776431.140557:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776431.140563:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449500672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140591:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449500672:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140596:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776431.140620:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499392 00000100:00100000:2.0:1789776431.140623:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499392 00000100:00100000:2.0:1789776431.140641:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499904 00000100:00100000:2.0:1789776431.140644:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499904 00000100:00100000:2.0:1789776431.140654:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500416 00000100:00100000:2.0:1789776431.140656:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500416 00000100:00100000:2.0:1789776431.140666:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500032 00000100:00100000:2.0:1789776431.140668:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500032 00000100:00100000:2.0:1789776431.140678:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500544 00000100:00100000:2.0:1789776431.140681:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500544 00000100:00100000:2.0:1789776431.140693:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499648 00000100:00100000:2.0:1789776431.140695:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499648 00000100:00100000:2.0:1789776431.140706:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776431.140712:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449499392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140742:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449499392:12345-0@lo:400:kworker.0 Request processed in 29us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140748:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776431.140761:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776431.140767:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449499904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140792:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449499904:12345-0@lo:400:kworker.0 Request processed in 26us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140797:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776431.140817:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776431.140822:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449500416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140850:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449500416:12345-0@lo:400:kworker.0 Request processed in 28us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140855:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776431.140879:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776431.140886:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449500032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140911:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449500032:12345-0@lo:400:kworker.0 Request processed in 26us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140916:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776431.140926:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776431.140932:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449500544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.140957:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449500544:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.140962:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776431.140974:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776431.140979:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449499648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141001:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449499648:12345-0@lo:400:kworker.0 Request processed in 23us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.141006:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789776431.141043:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776431.141047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776431.141049:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776431.141077:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449499648:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141093:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43c700 x1876716449500160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141115:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449500160:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141128:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2697100 x1876716449500672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141136:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449500672:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141146:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449499520:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141154:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43d500 x1876716449500032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141162:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449500032:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141171:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2696680 x1876716449500544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141179:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449500544:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141223:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449499392:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141232:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449499904:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141241:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449500416:0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.141252:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449499776:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43c380 x1876716449500288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500288:0@lo:400:kworker.0 00010000:00080000:2.0:1789776431.141281:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2696d80 x1876716449500800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.141296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789776431.144389:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776431.144535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449499264 00000100:00100000:3.0:1789776431.144543:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449499264 00000100:00100000:3.0:1789776431.144616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789776431.144627:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449499264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776431.144742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776431.144785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.144829:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501056 00000100:00100000:2.0:1789776431.144833:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501056 00000100:00100000:2.0:1789776431.144883:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776431.144891:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776431.144915:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776431.144953:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.144960:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789776431.145003:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2e300 x1876716449501056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776431.145023:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776431.148735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776431.148817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776431.150120:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449499264:12345-0@lo:400:kworker.0 Request processed in 5490us (10700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776431.150134:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789776431.151808:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449500928 00000100:00100000:2.0:1789776431.151823:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449500928 00000100:00100000:2.0:1789776431.151985:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789776431.151997:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776431.152025:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776431.152098:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449500928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.152106:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789776431.155084:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449499264:0@lo:400:kworker.0 00010000:00080000:0.0:1789776431.155123:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc370bb80 x1876716449500928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776431.155147:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449500928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789776431.522706:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776432.165658:0:10691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789776432.547054:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776433.570788:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776434.210826:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776434.212249:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449501312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776434.212321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776434.212476:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501312 00000100:00100000:3.0:1789776434.212485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501312 00000100:00100000:3.0:1789776434.212564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789776434.212574:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449501312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776434.212608:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776434.212713:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776434.212744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776434.212772:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501184 00000100:00100000:1.0:1789776434.212776:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501184 00000100:00100000:1.0:1789776434.212798:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776434.212814:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776434.212834:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776434.212886:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776434.212893:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776434.212954:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776434.213740:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449501312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1163us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776434.213749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789776434.216722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449501312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776434.364427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776434.364473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776434.364522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776434.364547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776434.364574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776434.364604:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662528 00000100:00100000:3.0:1789776434.364614:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662528 00000100:00100000:3.0:1789776434.364669:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662400 00000100:00100000:3.0:1789776434.364672:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662400 00000100:00100000:3.0:1789776434.364696:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776434.364705:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662528:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776434.364790:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662528:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776434.364798:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776434.364835:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1789776434.364843:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432662400:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776434.364870:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432662400:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776434.364876:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1789776434.364894:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662784 00000100:00100000:3.0:1789776434.364898:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662784 00000100:00100000:3.0:1789776434.364923:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662656 00000100:00100000:3.0:1789776434.364926:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662656 00000100:00100000:3.0:1789776434.364947:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1789776434.364953:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776434.364979:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776434.364985:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1789776434.364996:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1789776434.365002:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776434.365025:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432662656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776434.365031:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00080000:3.0:1789776434.365067:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776434.365072:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776434.365075:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776434.365082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776434.365697:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662272 00000100:00100000:1.0:1789776434.365705:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662272 00000100:00100000:1.0:1789776434.365750:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:1.0:1789776434.365758:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432662272:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776434.365809:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432662272:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776434.365817:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 276 00010000:00010000:1.0:1789776434.595931:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776435.622946:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776435.747637:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776435.747661:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449501440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776435.747710:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776435.747737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776435.747819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776435.747836:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501440 00000100:00100000:3.0:1789776435.747846:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501440 00000100:00100000:2.0:1789776435.747856:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501568 00000100:00100000:2.0:1789776435.747862:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501568 00000100:00100000:3.0:1789776435.747908:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789776435.747916:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776435.747921:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449501440:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776435.747930:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776435.747957:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789776435.747959:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776435.748004:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449501568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776435.748012:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789776435.748054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b4700 x1876716449501568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776435.748073:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449501568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776435.748201:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449501440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776435.748209:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789776435.748323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776435.748371:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3708e00 x1876716449501440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776435.748385:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449501440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776436.259021:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449501824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776436.259072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776436.259095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.259102:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449502080:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.259177:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449502464:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.262441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.262699:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449502592:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.262825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.262861:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449503104:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.262887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.262934:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449501952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.262975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.262998:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449502336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.263033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.263053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449502848:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.263077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.263095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449503360:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.263114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776436.263145:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502080 00000100:00100000:2.0:1789776436.263153:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502080 00000100:00100000:2.0:1789776436.263185:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502592 00000100:00100000:2.0:1789776436.263188:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502592 00000100:00100000:2.0:1789776436.263210:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503104 00000100:00100000:2.0:1789776436.263213:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503104 00000100:00100000:2.0:1789776436.263224:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502336 00000100:00100000:2.0:1789776436.263226:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502336 00000100:00100000:1.0:1789776436.265449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.265514:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.265550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.265573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449503488:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.265593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.265641:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501824 00000100:00100000:1.0:1789776436.265649:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501824 00000100:00100000:2.0:1789776436.265685:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789776436.265685:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789776436.265694:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449502080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.265694:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449501824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776436.265737:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776436.265796:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449501824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (6700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.265802:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789776436.265844:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502464 00000100:00100000:1.0:1789776436.265848:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502464 00000100:00100000:1.0:1789776436.265875:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776436.266338:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449502080:12345-0@lo:400:kworker.0 Request processed in 643us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.266346:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776436.266361:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776436.266367:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449502592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.266397:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449502592:12345-0@lo:400:kworker.0 Request processed in 30us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.266403:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776436.266414:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789776436.266420:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.266466:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449503104:12345-0@lo:400:kworker.0 Request processed in 46us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.266472:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789776436.266484:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789776436.266489:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449502336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.267613:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449502464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.267688:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449502464:12345-0@lo:400:kworker.0 Request processed in 1806us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.267697:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776436.267744:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502848 00000100:00100000:1.0:1789776436.267751:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502848 00000100:00100000:1.0:1789776436.267785:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503360 00000100:00100000:1.0:1789776436.267788:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503360 00000100:00100000:1.0:1789776436.267799:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502976 00000100:00100000:1.0:1789776436.267801:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502976 00000100:00100000:1.0:1789776436.267811:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503488 00000100:00100000:1.0:1789776436.267814:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503488 00000100:00100000:2.0:1789776436.267818:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449502336:12345-0@lo:400:kworker.0 Request processed in 1329us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.267825:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789776436.267829:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776436.267835:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449502848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.267856:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501952 00000100:00100000:2.0:1789776436.267859:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501952 00000100:00100000:1.0:1789776436.267866:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449502848:12345-0@lo:400:kworker.0 Request processed in 31us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.267872:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776436.267885:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789776436.267892:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449501952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.267923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449501952:12345-0@lo:400:kworker.0 Request processed in 32us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.267929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789776436.267965:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776436.267972:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449503360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.268002:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449503360:12345-0@lo:400:kworker.0 Request processed in 31us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.268008:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776436.268998:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776436.269012:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449502976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.269064:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449502976:12345-0@lo:400:kworker.0 Request processed in 57us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.269078:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776436.269101:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776436.269109:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449503488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.269144:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449503488:12345-0@lo:400:kworker.0 Request processed in 37us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.269149:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789776436.269422:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776436.269429:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776436.269464:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449501952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.269480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449502336:0@lo:400:kworker.0 00010000:00080000:2.0:1789776436.269509:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43df80 x1876716449502848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776436.269528:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449502848:0@lo:400:kworker.0 00010000:00080000:2.0:1789776436.269543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43e680 x1876716449503360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776436.269552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449503360:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.269598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449502080:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.269611:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449502592:0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.269623:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.269788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.269873:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.269920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.269946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.269969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.269989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.270008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776436.270043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502720 00000100:00100000:1.0:1789776436.270049:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502720 00000100:00100000:1.0:1789776436.270085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503232 00000100:00100000:1.0:1789776436.270088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503232 00000100:00100000:1.0:1789776436.270105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789776436.270112:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.270152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449502720:12345-0@lo:400:kworker.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.270171:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789776436.270197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789776436.270204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.270689:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449503232:12345-0@lo:400:kworker.0 Request processed in 483us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776436.270702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789776436.270723:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789776436.270750:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2697100 x1876716449502720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776436.270761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449502720:0@lo:400:kworker.0 00010000:00080000:1.0:1789776436.270785:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43f480 x1876716449503232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776436.270793:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789776436.270825:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449502464:0@lo:400:kworker.0 00010000:00080000:1.0:1789776436.270839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43c380 x1876716449502976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776436.270847:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449502976:0@lo:400:kworker.0 00010000:00080000:1.0:1789776436.270858:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43d500 x1876716449503488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776436.270866:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449503488:0@lo:400:kworker.0 00010000:00080000:1.0:1789776436.270942:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3479880 x1876716449501824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776436.270959:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449501824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776436.273406:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449502208 00000100:00100000:2.0:1789776436.273419:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449502208 00000100:00100000:2.0:1789776436.273483:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776436.273519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449502208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776436.273617:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449502208:12345-0@lo:400:kworker.0 Request processed in 126us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.273625:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776436.273685:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449502208:0@lo:400:kworker.0 00000100:00100000:3.0:1789776436.276027:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449501696 00000100:00100000:3.0:1789776436.276041:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449501696 00000100:00100000:2.0:1789776436.276206:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776436.276217:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776436.276254:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776436.276341:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (6553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776436.276349:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789776436.276395:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3708e00 x1876716449501696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776436.276427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449501696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789776436.642818:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776436.655082:0:10934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing yml_node 00010000:00010000:3.0:1789776437.668680:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776438.691919:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776439.331763:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449503616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776439.331850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776439.332107:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503616 00000100:00100000:3.0:1789776439.332116:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503616 00000100:00100000:3.0:1789776439.332172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776439.332182:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449503616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776439.332222:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789776439.332290:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449503616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776439.332297:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789776439.332547:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449503616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776439.332939:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449503744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776439.332990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776439.333077:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503744 00000100:00100000:2.0:1789776439.333082:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503744 00000100:00100000:2.0:1789776439.333122:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789776439.333130:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449503744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776439.333153:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776439.333351:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449503744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 221us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776439.333358:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789776439.333422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449503744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776439.487074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776439.487211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776439.487256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776439.487451:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432662912 00000100:00100000:0.0:1789776439.487485:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432662912 00000100:00100000:0.0:1789776439.487616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:0.0:1789776439.487628:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432662912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776439.487737:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432662912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 111us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776439.487747:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:2.0:1789776439.488911:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663168 00000100:00100000:2.0:1789776439.488923:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663168 00000100:00100000:2.0:1789776439.489010:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663040 00000100:00100000:2.0:1789776439.489014:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663040 00000100:00100000:3.0:1789776439.489288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:3.0:1789776439.489302:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432663168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776439.489390:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432663168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776439.489414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1789776439.489524:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1789776439.489533:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432663040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776439.489567:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432663040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776439.489576:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00080000:0.0:1789776439.490450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776439.490459:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776439.495407:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776439.495463:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776439.495687:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663296 00000100:00100000:2.0:1789776439.495709:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663296 00000100:00100000:2.0:1789776439.495840:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663424 00000100:00100000:2.0:1789776439.495844:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663424 00000100:00100000:1.0:1789776439.495915:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1789776439.495949:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432663296:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:1.0:1789776439.496006:0:8528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884995 00000100:00080000:1.0:1789776439.496019:0:8528:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2529800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789776439.496077:0:8528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789776439.496305:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+2:2410:x1876716432663296:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 360us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776439.496316:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00010000:00010000:1.0:1789776439.496347:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776439.497182:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776439.497188:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776439.497336:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1789776439.497349:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432663424:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1789776439.497402:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88499c 00000100:00080000:2.0:1789776439.497414:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776439.497466:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789776439.497638:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+2:2410:x1876716432663424:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 293us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776439.497646:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00010000:00010000:3.0:1789776439.497851:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776439.717130:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776440.742037:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776440.869297:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776440.869324:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776440.869400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776440.869474:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449503872 00000100:00100000:0.0:1789776440.869481:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449503872 00000100:00100000:0.0:1789776440.869559:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776440.869570:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449503872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776440.869605:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776440.869655:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449503872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776440.869662:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789776440.869697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776440.869742:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b4700 x1876716449503872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776440.869762:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776440.875775:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776440.875799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449504000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776440.875872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776440.875963:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504000 00000100:00100000:1.0:1789776440.875971:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504000 00000100:00100000:1.0:1789776440.876039:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776440.876048:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449504000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776440.876073:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776440.876120:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449504000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776440.876128:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789776440.876182:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc347b100 x1876716449504000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776440.876201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449504000:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789776440.876225:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789776441.102940:0:11118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.111 00000100:00100000:2.0:1789776441.378842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449504384:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.378887:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449504128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776441.378925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776441.378925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776441.379013:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449504256:0@lo:400:kworker.0 00000100:00100000:3.0:1789776441.379942:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504384 00000100:00100000:3.0:1789776441.379952:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504384 00000100:00100000:3.0:1789776441.380010:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789776441.380020:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449504384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.380116:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380144:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449504896:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.380168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.380190:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504640 00000100:00100000:2.0:1789776441.380195:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504640 00000100:00100000:0.0:1789776441.380205:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449505152:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380229:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776441.380236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.380243:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449504640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.380254:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789776441.380263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449504768:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380290:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449504640:12345-0@lo:400:kworker.0 Request processed in 49us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776441.380299:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776441.380303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.380317:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505152 00000100:00100000:2.0:1789776441.380321:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505152 00000100:00100000:2.0:1789776441.380352:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789776441.380353:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449505280:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380361:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449505152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.380381:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.380411:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449505152:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.380415:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380421:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789776441.380433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449505152:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380434:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505280 00000100:00100000:2.0:1789776441.380440:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505280 00000100:00100000:2.0:1789776441.380458:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789776441.380474:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449505280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.380520:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449505280:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776441.380536:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789776441.380555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776441.380559:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776441.381304:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3ff480 x1876716449505280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776441.381925:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449505280:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.381963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449504512:0@lo:400:kworker.0 00000100:00100000:3.0:1789776441.381994:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449504384:12345-0@lo:400:kworker.0 Request processed in 1969us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776441.382004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789776441.382010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776441.382050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449505024:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.382075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.382092:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504768 00000100:00100000:0.0:1789776441.382096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449505536:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.382099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504768 00000100:00100000:0.0:1789776441.382137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776441.382153:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504512 00000100:00100000:2.0:1789776441.382157:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504512 00000100:00100000:2.0:1789776441.382175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776441.382185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449504768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.382197:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504128 00000100:00100000:0.0:1789776441.382203:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504128 00000100:00100000:2.0:1789776441.382241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449504768:12345-0@lo:400:kworker.0 Request processed in 58us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.382248:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789776441.382250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789776441.382259:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449504128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776441.382270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776441.382278:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449504512:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789776441.382285:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776441.382316:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449504512:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776441.382322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789776441.382343:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449504128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.382350:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776441.382371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505024 00000100:00100000:0.0:1789776441.382375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505024 00000100:00100000:0.0:1789776441.382408:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776441.382415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449505024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.382451:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449505024:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.382457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776441.382484:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505536 00000100:00100000:0.0:1789776441.382488:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505536 00000100:00100000:0.0:1789776441.382545:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776441.382553:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449505536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.382583:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449505536:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.382589:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789776441.382752:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776441.382756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776441.382778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449504512:0@lo:400:kworker.0 00010000:00080000:0.0:1789776441.382792:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fed80 x1876716449505024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776441.382815:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449505024:0@lo:400:kworker.0 00010000:00080000:0.0:1789776441.382828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fdf80 x1876716449505536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776441.384518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449505536:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.384583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776441.384708:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449505408:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.384759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776441.384809:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449504384:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.384868:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449504768:0@lo:400:kworker.0 00010000:00080000:0.0:1789776441.384882:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3795f80 x1876716449504128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776441.384901:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449504128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776441.384979:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449505664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776441.385004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776441.385036:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505664 00000100:00100000:0.0:1789776441.385042:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505664 00000100:00100000:0.0:1789776441.385096:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776441.385105:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449505664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776441.385137:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776441.385179:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449505664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776441.385186:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789776441.385217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776441.385220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789776441.385243:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b5500 x1876716449505664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776441.385247:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504256 00000100:00100000:1.0:1789776441.385250:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504256 00000100:00100000:0.0:1789776441.385255:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449505664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776441.385288:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789776441.385294:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449504256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776441.385329:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449504256:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776441.385479:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449504896 00000100:00100000:3.0:1789776441.385485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449504896 00000100:00100000:3.0:1789776441.385641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789776441.385650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449504896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776441.385711:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449504896:12345-0@lo:400:kworker.0 Request processed in 63us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776441.385718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789776441.385903:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776441.385927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449504896:0@lo:400:kworker.0 00000100:00100000:0.0:1789776441.385963:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449504256:0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.387011:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505408 00000100:00100000:2.0:1789776441.387020:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505408 00000100:00100000:2.0:1789776441.387079:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789776441.387089:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449505408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776441.387176:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449505408:12345-0@lo:400:kworker.0 Request processed in 88us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776441.387184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789776441.387241:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fe680 x1876716449505408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776441.387253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449505408:0@lo:400:kworker.0 00000100:00100000:1.0:1789776441.387653:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:3.0:1789776441.762617:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776442.787759:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776443.371054:0:11215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.111 00010000:00010000:1.0:1789776443.811218:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776444.454223:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449505792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776444.454299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776444.454381:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505792 00000100:00100000:0.0:1789776444.454389:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505792 00000100:00100000:0.0:1789776444.454439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789776444.454448:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449505792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776444.454518:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776444.454573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449505792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776444.454581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789776444.455117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449505920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776444.455154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776444.455199:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449505920 00000100:00100000:1.0:1789776444.455204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449505920 00000100:00100000:1.0:1789776444.455233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789776444.455240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449505920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776444.455262:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776444.455312:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449505920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776444.455319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789776444.455373:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449505920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776444.455807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449505792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776444.606018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776444.606081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776444.606109:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776444.606139:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663552 00000100:00100000:3.0:1789776444.606148:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663552 00000100:00100000:3.0:1789776444.606210:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:3.0:1789776444.606221:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432663552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776444.606295:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432663552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776444.606317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:3.0:1789776444.606357:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663680 00000100:00100000:3.0:1789776444.606361:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663680 00000100:00100000:3.0:1789776444.606397:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663808 00000100:00100000:3.0:1789776444.606399:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663808 00000100:00100000:3.0:1789776444.606421:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1789776444.606427:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432663680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776444.606469:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432663680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776444.606475:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1789776444.606487:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:3.0:1789776444.606521:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432663808:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776444.606544:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432663808:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 52us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776444.606550:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00080000:0.0:1789776444.607948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776444.607956:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776444.834760:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789776445.477414:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:3.0:1789776445.477424:0:9510:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d3800/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:2.0:1789776445.477486:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d3800/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-OST0001 00000020:00000080:2.0:1789776445.477567:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc24d6800 for lustre-OST0001 00000001:00100000:1.0:1789776445.479003:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:1.0:1789776445.479012:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5cfc24c000/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:3.0:1789776445.479191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc24c000/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-OST0000 00000020:00000080:3.0:1789776445.479252:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc2529800 for lustre-OST0000 00010000:00010000:0.0:1789776445.869091:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776445.982082:0:11312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.111 00000100:00100000:1.0:1789776445.986660:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449506048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776445.986730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776445.986834:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506048 00000100:00100000:2.0:1789776445.986842:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506048 00000100:00100000:2.0:1789776445.986921:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776445.986931:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449506048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776445.986963:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776445.987015:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449506048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776445.987023:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776445.987044:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776445.987052:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449506176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776445.987075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776445.987113:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506176 00000100:00100000:2.0:1789776445.987116:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506176 00000100:00100000:2.0:1789776445.987138:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789776445.987143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776445.987144:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449506176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776445.987156:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776445.987187:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449506176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776445.987193:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789776445.987227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f72300 x1876716449506176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776445.987246:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449506176:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789776445.987274:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc347b100 x1876716449506048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776445.987296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449506048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776446.498815:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776446.498840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449506432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776446.498923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776446.499161:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776446.499172:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776446.499203:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506432 00000100:00100000:2.0:1789776446.499210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776446.499215:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506432 00000100:00100000:2.0:1789776446.499249:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506560 00000100:00100000:2.0:1789776446.499254:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506560 00000100:00100000:2.0:1789776446.499289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776446.499305:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449506432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776446.499335:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776446.499386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449506432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.500092:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449506944:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.500183:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449507456:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.500228:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789776446.500234:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449506304:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.500287:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449507072:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.500325:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449507584:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.500374:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506304 00000100:00100000:0.0:1789776446.500379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506304 00000100:00100000:0.0:1789776446.500412:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789776446.500420:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449506304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500459:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449506304:12345-0@lo:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.500466:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789776446.500514:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507072 00000100:00100000:0.0:1789776446.500518:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507072 00000100:00100000:0.0:1789776446.500542:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776446.500550:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449507072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500598:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449507072:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.500605:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776446.500637:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449506304:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449507072:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506944 00000100:00100000:0.0:1789776446.500696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506944 00000100:00100000:0.0:1789776446.500720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507456 00000100:00100000:0.0:1789776446.500723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507456 00000100:00100000:0.0:1789776446.500737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507584 00000100:00100000:0.0:1789776446.500740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507584 00000100:00100000:0.0:1789776446.500754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789776446.500760:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449506944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449506944:12345-0@lo:400:kworker.0 Request processed in 37us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.500804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789776446.500816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789776446.500821:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449507456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.500846:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449507456:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.500851:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789776446.500976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776446.500983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501014:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449507584:12345-0@lo:400:kworker.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.501020:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789776446.501047:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35d500 x1876716449507584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776446.501057:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449507584:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501067:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449506944:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501087:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449507456:0@lo:400:kworker.0 00000100:00080000:0.0:1789776446.501272:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776446.501277:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776446.501280:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776446.501292:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449506816:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.501339:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449507328:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.501371:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789776446.501377:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449506688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.501408:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449507200:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776446.501444:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507328 00000100:00100000:0.0:1789776446.501448:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507328 00000100:00100000:0.0:1789776446.501470:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506688 00000100:00100000:0.0:1789776446.501474:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506688 00000100:00100000:0.0:1789776446.501483:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507200 00000100:00100000:0.0:1789776446.501484:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507200 00000100:00100000:0.0:1789776446.501522:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776446.501528:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501575:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449507328:12345-0@lo:400:kworker.0 Request processed in 36us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.501581:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776446.501594:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789776446.501599:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449506688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501639:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449506688:12345-0@lo:400:kworker.0 Request processed in 40us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.501645:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789776446.501657:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789776446.501663:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449507200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501688:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449507200:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.501693:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789776446.501709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776446.501711:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776446.501728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449506688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501736:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449507200:0@lo:400:kworker.0 00010000:00080000:0.0:1789776446.501747:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815d180 x1876716449507328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776446.501756:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449507328:0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.501791:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449506816 00000100:00100000:0.0:1789776446.501794:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449506816 00000100:00100000:0.0:1789776446.501814:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789776446.501821:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449506816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776446.502297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449506816:12345-0@lo:400:kworker.0 Request processed in 475us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776446.502305:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789776446.502339:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449506816:0@lo:400:kworker.0 00010000:00080000:0.0:1789776446.502395:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3478380 x1876716449506432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776446.502421:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449506432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776446.504911:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789776446.504939:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449506560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776446.504973:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00002000:00000024:3.0:1789776446.504987:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776446.505083:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (5872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776446.505090:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789776446.505138:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3795c00 x1876716449506560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776446.505160:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449506560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789776446.885205:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776447.618944:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 20:07:27 EDT 2026 00010000:00010000:3.0:1789776447.906715:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776448.931275:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776449.573638:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449507712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776449.573713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776449.573894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507712 00000100:00100000:2.0:1789776449.573903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507712 00000100:00100000:2.0:1789776449.573954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789776449.573964:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449507712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776449.574001:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776449.574053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449507712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776449.574060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789776449.574103:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449507712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776449.574269:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776449.577697:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449507840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776449.577773:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776449.577827:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507840 00000100:00100000:2.0:1789776449.577841:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507840 00000100:00100000:2.0:1789776449.577885:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789776449.577894:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449507840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776449.577929:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776449.577977:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449507840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776449.577984:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789776449.578031:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449507840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776449.723070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776449.723242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432663936 00000100:00100000:0.0:1789776449.723252:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432663936 00000100:00100000:0.0:1789776449.723312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00100000:0.0:1789776449.723322:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2411:x1876716432663936:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776449.723409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2411:x1876716432663936:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776449.723418:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00100000:3.0:1789776449.730754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776449.735226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776449.735580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664064 00000100:00100000:1.0:1789776449.735592:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664064 00000100:00100000:1.0:1789776449.735659:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664192 00000100:00100000:1.0:1789776449.735662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664192 00000100:00100000:1.0:1789776449.735701:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:1.0:1789776449.735712:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432664064:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776449.735788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432664064:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (5044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776449.735796:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:1.0:1789776449.735827:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:1.0:1789776449.735834:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432664192:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776449.735861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432664192:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776449.735867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00080000:2.0:1789776449.739379:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776449.739390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776449.956308:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776450.978688:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776451.106853:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449507968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776451.106937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.107019:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776451.107027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449508096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776451.107055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776451.107205:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508096 00000100:00100000:1.0:1789776451.107205:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449507968 00000100:00100000:2.0:1789776451.107212:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508096 00000100:00100000:1.0:1789776451.107212:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449507968 00000100:00100000:2.0:1789776451.107326:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776451.107338:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449508096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776451.107372:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776451.107422:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449508096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776451.107429:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789776451.107469:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fd880 x1876716449508096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776451.107521:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449508096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776451.110631:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789776451.110662:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449507968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776451.110689:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776451.110850:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449507968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776451.110876:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789776451.114347:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3795880 x1876716449507968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776451.114377:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449507968:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789776451.114955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776451.619102:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449508224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776451.619179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.619249:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508224 00000100:00100000:0.0:1789776451.619257:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508224 00000100:00100000:0.0:1789776451.619321:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789776451.619330:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449508224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776451.619650:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449508480:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619723:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449508992:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619766:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449509504:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789776451.619819:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619856:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449509120:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619888:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449509632:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.619905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776451.619937:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509504 00000100:00100000:1.0:1789776451.619941:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509504 00000100:00100000:1.0:1789776451.619967:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508608 00000100:00100000:1.0:1789776451.619970:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508608 00000100:00100000:1.0:1789776451.619982:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509120 00000100:00100000:1.0:1789776451.619984:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509120 00000100:00100000:1.0:1789776451.619997:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789776451.620004:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.620049:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449509504:12345-0@lo:400:kworker.0 Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776451.620056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789776451.620096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789776451.620102:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.620130:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449508608:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776451.620136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789776451.620149:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776451.620155:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449509120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.620181:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449509120:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776451.620186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776451.620227:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.620236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449509120:0@lo:400:kworker.0 00010000:00080000:1.0:1789776451.620247:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fdf80 x1876716449509504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776451.620257:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449509504:0@lo:400:kworker.0 00000100:00100000:3.0:1789776451.620324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508480 00000100:00100000:3.0:1789776451.620328:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508480 00000100:00100000:3.0:1789776451.620369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789776451.620376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776451.620415:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449508480:12345-0@lo:400:kworker.0 Request processed in 40us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776451.620421:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789776451.620459:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449508480:0@lo:400:kworker.0 00002000:00000024:0.0:1789776451.620616:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776451.620651:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449508224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1323us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.620658:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789776451.620678:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776451.620682:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776451.620684:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776451.620702:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508992 00000100:00100000:0.0:1789776451.620705:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508992 00000100:00100000:0.0:1789776451.620740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789776451.620748:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449508992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.620786:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449508992:12345-0@lo:400:kworker.0 Request processed in 39us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.620791:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789776451.620809:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509632 00000100:00100000:0.0:1789776451.620812:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509632 00000100:00100000:0.0:1789776451.620842:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776451.620849:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449509632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.620878:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449509632:12345-0@lo:400:kworker.0 Request processed in 30us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.620884:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789776451.620900:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776451.620914:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449508352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776451.620943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.620964:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449508864:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.620999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.621017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449509376:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.621056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789776451.621062:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449508736:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.621106:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776451.621157:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508352 00000100:00100000:0.0:1789776451.621160:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508352 00000100:00100000:0.0:1789776451.621181:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776451.621188:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449508352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776451.621200:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776451.621230:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449508352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.621236:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776451.621252:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508736 00000100:00100000:0.0:1789776451.621255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508736 00000100:00100000:0.0:1789776451.621276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776451.621281:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449508736:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.621315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776451.621342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449508736:0@lo:400:kworker.0 00010000:00080000:0.0:1789776451.621353:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3478380 x1876716449508352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776451.621382:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449508352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776451.621403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449508864 00000100:00100000:0.0:1789776451.621407:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449508864 00000100:00100000:0.0:1789776451.621427:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509376 00000100:00100000:0.0:1789776451.621429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509376 00000100:00100000:0.0:1789776451.621444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509248 00000100:00100000:0.0:1789776451.621447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509248 00000100:00100000:0.0:1789776451.621460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789776451.621480:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449508864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449508864:12345-0@lo:400:kworker.0 Request processed in 73us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.621545:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789776451.621556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789776451.621561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621602:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449509376:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.621608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789776451.621620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789776451.621626:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449509248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621652:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449509248:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776451.621658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789776451.621674:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776451.621677:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776451.621695:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fd180 x1876716449509248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776451.621717:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621729:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449508864:0@lo:400:kworker.0 00000100:00100000:0.0:1789776451.621737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449509376:0@lo:400:kworker.0 00010000:00080000:0.0:1789776451.621766:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedcedf80 x1876716449508224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776451.621779:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449508224:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789776451.622126:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fed80 x1876716449509632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776451.622136:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449509632:0@lo:400:kworker.0 00000100:00100000:1.0:1789776451.622150:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449508992:0@lo:400:kworker.0 00010000:00010000:1.0:1789776452.003073:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776453.027029:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776454.054837:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776454.692464:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776454.692516:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449509760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776454.692948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776454.693058:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449509888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776454.693149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776454.693211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509760 00000100:00100000:2.0:1789776454.693219:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509760 00000100:00100000:2.0:1789776454.693264:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449509888 00000100:00100000:2.0:1789776454.693267:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449509888 00000100:00100000:2.0:1789776454.693283:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789776454.693293:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449509760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776454.693338:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776454.693429:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449509760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776454.693436:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789776454.693453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789776454.693460:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449509888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776454.693480:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776454.693549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449509888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776454.693557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789776454.693609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449509888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776454.693624:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449509760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776454.848549:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776454.848645:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664320 00000100:00100000:3.0:1789776454.848657:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776454.848666:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664320 00000100:00100000:2.0:1789776454.848765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 284 00000100:00100000:1.0:1789776454.848777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664448 00000100:00100000:2.0:1789776454.848790:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432664320:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776454.848797:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664448 00000100:00100000:2.0:1789776454.848915:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432664320:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 132us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.848916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:1.0:1789776454.848947:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432664448:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776454.848960:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 284 00000100:00100000:1.0:1789776454.849049:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432664448:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.849059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00080000:1.0:1789776454.849101:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776454.855916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776454.856011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664576 00000100:00100000:1.0:1789776454.856022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664576 00000100:00100000:1.0:1789776454.856088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1789776454.856098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432664576:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776454.856392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432664576:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 294us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.856400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00080000:2.0:1789776454.856938:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789776455.074659:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776456.105347:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776456.227577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776456.227604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449510016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776456.227612:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776456.227626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776456.227715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.230065:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510144 00000100:00100000:2.0:1789776456.230081:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510144 00000100:00100000:2.0:1789776456.230189:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776456.230201:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776456.230233:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776456.230312:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.230320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789776456.230342:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776456.230359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.230414:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510016 00000100:00100000:2.0:1789776456.230418:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510016 00000100:00100000:2.0:1789776456.230444:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776456.230451:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449510016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776456.230464:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776456.230509:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449510016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.230516:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789776456.230530:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776456.230573:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc347b800 x1876716449510144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776456.230596:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449510144:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789776456.230645:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3794700 x1876716449510016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776456.230657:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449510016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776456.739642:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776456.739713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.739776:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776456.739783:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449510400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776456.739808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.739854:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510272 00000100:00100000:2.0:1789776456.739862:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510272 00000100:00100000:2.0:1789776456.739914:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510400 00000100:00100000:2.0:1789776456.739917:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510400 00000100:00100000:2.0:1789776456.739935:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776456.739944:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449510272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776456.739974:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776456.740035:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449510272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740043:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776456.740065:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776456.740073:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449510400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776456.740085:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776456.740119:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449510400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740125:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789776456.740143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776456.740172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449510528:0@lo:400:kworker.0 00000100:00100000:3.0:1789776456.740196:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449510656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.740239:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449511040:0@lo:400:kworker.0 00000100:00100000:3.0:1789776456.740245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776456.740268:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449511168:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776456.740300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.740307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449511552:0@lo:400:kworker.0 00000100:00100000:3.0:1789776456.740336:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449510784:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.740383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510528 00000100:00100000:2.0:1789776456.740387:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510528 00000100:00100000:2.0:1789776456.740426:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789776456.740433:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740462:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449510528:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740467:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789776456.740526:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511040 00000100:00100000:2.0:1789776456.740530:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511040 00000100:00100000:2.0:1789776456.740555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789776456.740562:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449511040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449511040:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789776456.740615:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510656 00000100:00100000:2.0:1789776456.740618:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510656 00000100:00100000:2.0:1789776456.740639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511168 00000100:00100000:2.0:1789776456.740642:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511168 00000100:00100000:2.0:1789776456.740658:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511552 00000100:00100000:2.0:1789776456.740661:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511552 00000100:00100000:2.0:1789776456.740677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776456.740683:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449510656:12345-0@lo:400:kworker.0 Request processed in 45us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776456.740748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789776456.740754:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449511168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740778:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449511168:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740783:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789776456.740794:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789776456.740800:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449511552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449511552:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.740833:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789776456.740857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449510912:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.740898:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449511424:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.740918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776456.740941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510912 00000100:00100000:2.0:1789776456.740945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510912 00000100:00100000:2.0:1789776456.740958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511424 00000100:00100000:2.0:1789776456.740960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511424 00000100:00100000:2.0:1789776456.740974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776456.740980:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449510912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449510912:12345-0@lo:400:kworker.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.741026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776456.741038:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789776456.741043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449511424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741070:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449511424:12345-0@lo:400:kworker.0 Request processed in 27us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.741076:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1789776456.741116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776456.741120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776456.741145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449510912:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449511424:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741184:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449510656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741193:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449511168:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741214:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449510528:0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741223:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449511040:0@lo:400:kworker.0 00010000:00080000:2.0:1789776456.741234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fdc00 x1876716449511552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776456.741244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449511552:0@lo:400:kworker.0 00000100:00100000:3.0:1789776456.741652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776456.741676:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449511296:0@lo:400:kworker.0 00000100:00100000:3.0:1789776456.741700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789776456.741726:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc347b800 x1876716449510400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776456.741743:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449510400:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789776456.741756:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3794700 x1876716449510272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776456.741767:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776456.741836:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449510784 00000100:00100000:2.0:1789776456.741841:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449510784 00000100:00100000:2.0:1789776456.741877:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789776456.741885:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.741927:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449510784:12345-0@lo:400:kworker.0 Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.741941:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789776456.741958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511296 00000100:00100000:2.0:1789776456.741962:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511296 00000100:00100000:2.0:1789776456.741989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789776456.741994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449511296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776456.742092:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449511296:12345-0@lo:400:kworker.0 Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776456.742099:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789776456.742115:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776456.742137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449510784:0@lo:400:kworker.0 00010000:00080000:2.0:1789776456.742148:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fe680 x1876716449511296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776456.742158:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449511296:0@lo:400:kworker.0 00010000:00010000:1.0:1789776457.123664:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776458.147628:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776459.174061:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776459.810855:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776459.812738:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449511808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776459.812853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776459.813106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511808 00000100:00100000:3.0:1789776459.813117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511808 00000100:00100000:3.0:1789776459.813195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789776459.813206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449511808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776459.813253:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789776459.813326:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449511808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776459.813334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789776459.813542:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449511808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776459.817374:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449511680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776459.819109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776459.819253:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511680 00000100:00100000:3.0:1789776459.819265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511680 00000100:00100000:3.0:1789776459.819347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789776459.819379:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449511680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776459.819440:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776459.819570:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449511680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776459.819578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776459.820641:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449511680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776459.963383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776459.963449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776459.963886:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664704 00000100:00100000:0.0:1789776459.963902:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664704 00000100:00100000:3.0:1789776459.964752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776459.964798:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:0.0:1789776459.964817:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432664704:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776459.964924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2413:x1876716432664704:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 113us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776459.964932:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:2.0:1789776459.966148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664960 00000100:00100000:2.0:1789776459.966161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664960 00000100:00100000:2.0:1789776459.966239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432664832 00000100:00100000:2.0:1789776459.966243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432664832 00000100:00100000:2.0:1789776459.966276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00080000:3.0:1789776459.966285:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776459.966287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432664960:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1789776459.966292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776459.966473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:3.0:1789776459.966571:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432664832:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776459.968714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432664832:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2134us (5209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776459.968729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:2.0:1789776459.974556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432664960:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 8250us (11085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776459.974577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 109 00010000:00010000:1.0:1789776460.195047:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776461.221187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776461.346698:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776461.346739:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449511936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776461.346842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776461.347025:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449512064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776461.347066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776461.347116:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449511936 00000100:00100000:1.0:1789776461.347126:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449511936 00000100:00100000:1.0:1789776461.347189:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512064 00000100:00100000:1.0:1789776461.347193:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512064 00000100:00100000:1.0:1789776461.347215:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789776461.347226:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449511936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776461.347263:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776461.347334:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449511936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776461.347343:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789776461.347378:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776461.347385:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449512064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776461.347395:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776461.347424:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449512064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776461.347431:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789776461.347450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776461.347698:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3797100 x1876716449511936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776461.347720:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449511936:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789776461.348109:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff438700 x1876716449512064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776461.348125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449512064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776461.859350:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776461.859383:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449512192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776461.859479:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776461.859615:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512192 00000100:00100000:1.0:1789776461.859624:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512192 00000100:00100000:1.0:1789776461.859701:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776461.859713:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449512192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776461.859754:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776461.859810:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449512192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776461.859818:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789776461.859864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789776461.859904:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff438700 x1876716449512192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776461.859927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449512192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776461.860127:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449512320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776461.860168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776461.860212:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512320 00000100:00100000:2.0:1789776461.860217:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512320 00000100:00100000:2.0:1789776461.860249:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789776461.860256:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449512320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776461.860289:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776461.860321:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449512320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776461.860328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789776461.860341:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789776461.860462:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3797100 x1876716449512320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776461.860475:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449512320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776461.861733:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449512576:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.861798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.861829:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449513088:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.861850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.861867:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449513600:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.861906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.861929:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789776461.861941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449512704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.861970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.861988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449513216:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.862007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.862023:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449513728:0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.862187:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512704 00000100:00100000:2.0:1789776461.862196:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512704 00000100:00100000:2.0:1789776461.862247:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776461.862256:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449512704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.862335:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449512704:12345-0@lo:400:kworker.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776461.862352:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776461.862378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512576 00000100:00100000:3.0:1789776461.862715:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449512448:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.862761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776461.862794:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449512960:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.862819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776461.862838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449513472:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.862863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776461.862884:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789776461.862891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449512832:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.862914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776461.862934:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449513344:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.862955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776461.862986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512960 00000100:00100000:3.0:1789776461.862991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512960 00000100:00100000:3.0:1789776461.863021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789776461.863120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512576 00000100:00100000:2.0:1789776461.863147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513088 00000100:00100000:2.0:1789776461.863150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513088 00000100:00100000:2.0:1789776461.863173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513600 00000100:00100000:2.0:1789776461.863176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513600 00000100:00100000:2.0:1789776461.863187:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513216 00000100:00100000:2.0:1789776461.863190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513216 00000100:00100000:2.0:1789776461.863201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512832 00000100:00100000:2.0:1789776461.863203:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512832 00000100:00100000:2.0:1789776461.863216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776461.863222:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.863277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449512576:12345-0@lo:400:kworker.0 Request processed in 45us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776461.863284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776461.863297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776461.863303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449513088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.863332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449513088:12345-0@lo:400:kworker.0 Request processed in 30us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776461.863338:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776461.863362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789776461.863369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449513600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776461.863709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449512576:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449513088:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449512704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863769:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513728 00000100:00100000:0.0:1789776461.863772:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513728 00000100:00100000:0.0:1789776461.863794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789776461.863800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449513216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449513216:12345-0@lo:400:kworker.0 Request processed in 37us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776461.863843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789776461.863853:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789776461.863858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449512832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449512832:12345-0@lo:400:kworker.0 Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776461.863893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789776461.863903:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789776461.863908:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449513728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.863946:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449513728:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776461.863959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789776461.863978:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513472 00000100:00100000:0.0:1789776461.863982:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513472 00010000:00080000:1.0:1789776461.863996:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ca80 x1876716449513216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776461.864004:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513344 00000100:00100000:0.0:1789776461.864006:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513344 00000100:00100000:1.0:1789776461.864009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449513216:0@lo:400:kworker.0 00010000:00080000:1.0:1789776461.864020:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc394700 x1876716449513728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776461.864024:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776461.864029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449513728:0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.864118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449512960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776461.864152:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449512960:12345-0@lo:400:kworker.0 Request processed in 1126us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776461.864158:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776461.864233:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776461.864236:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449513472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.864279:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449513472:12345-0@lo:400:kworker.0 Request processed in 34us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776461.864285:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776461.864377:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449513600:12345-0@lo:400:kworker.0 Request processed in 1007us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776461.864379:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449513344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.864390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789776461.864419:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449513344:12345-0@lo:400:kworker.0 Request processed in 179us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776461.864426:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789776461.864430:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449512448 00000100:00100000:2.0:1789776461.864440:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449512448 00000100:00100000:2.0:1789776461.864472:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789776461.864479:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449512448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776461.864531:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449512448:12345-0@lo:400:kworker.0 Request processed in 52us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776461.864537:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789776461.864555:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449512832:0@lo:400:kworker.0 00010000:00080000:1.0:1789776461.864568:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ed80 x1876716449513344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776461.864583:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776461.864587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449513344:0@lo:400:kworker.0 00000100:00080000:2.0:1789776461.864588:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776461.864597:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449512448:0@lo:400:kworker.0 00000100:00100000:1.0:1789776461.864608:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449512960:0@lo:400:kworker.0 00010000:00080000:1.0:1789776461.864618:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc397800 x1876716449513472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776461.864626:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449513472:0@lo:400:kworker.0 00000100:00100000:0.0:1789776461.865145:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449513600:0@lo:400:kworker.0 00000001:02000400:2.0:1789776461.996355:0:11990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:07:41 (1789776461) === 00010000:00010000:2.0:1789776462.260368:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776462.427120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.427340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665088 00000100:00100000:0.0:1789776462.427541:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665088 00000100:00100000:0.0:1789776462.427627:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:0.0:1789776462.427639:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:8733:x1876716432665088:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776462.427660:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776462.427686:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f8600/0xf13b8042cb884a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5693 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776462.427726:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f8600/0xf13b8042cb884a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5693 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776462.427740:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc25f8600/0xf13b8042cb884a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5693 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776462.427752:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8600, rc 0) 00000100:00100000:0.0:1789776462.427832:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665088:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 195us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.427859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:0.0:1789776462.432307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776462.434729:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665216 00000100:00100000:2.0:1789776462.434750:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665216 00000100:00100000:2.0:1789776462.434901:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:2.0:1789776462.434917:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665216:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776462.435153:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665216:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 239us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.435163:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:3.0:1789776462.439561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.445805:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665344 00000100:00100000:0.0:1789776462.445826:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665344 00000100:00100000:0.0:1789776462.445917:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00100000:0.0:1789776462.445929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665344:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789776462.446155:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665344:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 227us (6664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.446164:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00100000:3.0:1789776462.458543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.458663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665472 00000100:00100000:0.0:1789776462.458676:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665472 00000100:00100000:0.0:1789776462.458754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00100000:0.0:1789776462.458766:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665472:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776462.459002:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665472:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 237us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.459011:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00100000:3.0:1789776462.502018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776462.502918:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665600 00000100:00100000:1.0:1789776462.502934:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665600 00000100:00100000:1.0:1789776462.503020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 292 00000100:00100000:1.0:1789776462.503033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665600:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789776462.503250:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665600:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 218us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776462.503271:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 292 00000100:00100000:3.0:1789776462.515755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.517460:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665728 00000100:00100000:0.0:1789776462.517477:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665728 00000100:00100000:0.0:1789776462.517578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:0.0:1789776462.517590:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665728:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776462.517807:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8737:x1876716432665728:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 217us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.517816:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:3.0:1789776462.522020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776462.522269:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665856 00000100:00100000:2.0:1789776462.522285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665856 00000100:00100000:2.0:1789776462.522364:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:2.0:1789776462.522387:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:8733:x1876716432665856:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789776462.522412:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776462.522442:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb884a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab56c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.522487:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb884a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56c4 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.522573:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb884a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56c4 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.522585:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3400, rc 0) 00000100:00100000:2.0:1789776462.522760:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:8733:x1876716432665856:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 374us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.522768:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:3.0:1789776462.525728:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776462.525862:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432665984 00000100:00100000:1.0:1789776462.525874:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432665984 00000100:00100000:1.0:1789776462.526112:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1789776462.526126:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:8733:x1876716432665984:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789776462.526175:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789776462.526208:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789776462.526213:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789776462.526217:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789776462.526220:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789776462.526222:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789776462.537777:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:8733:x1876716432665984:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 11632us (12041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776462.537797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:3.0:1789776462.544790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776462.545182:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666112 00000100:00100000:2.0:1789776462.545203:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666112 00000100:00100000:2.0:1789776462.545643:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:2.0:1789776462.545663:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:8733:x1876716432666112:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789776462.545689:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776462.545727:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab56cb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.546105:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.546123:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776462.546136:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2a00, rc 0) 00000100:00100000:2.0:1789776462.548823:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8733:x1876716432666112:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 3151us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.548837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:3.0:1789776462.553623:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776462.556980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666240 00000100:00100000:2.0:1789776462.557032:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666240 00000100:00100000:2.0:1789776462.557856:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:2.0:1789776462.557877:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8733:x1876716432666240:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776462.558391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8733:x1876716432666240:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 520us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.558402:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:3.0:1789776462.562759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.565390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666368 00000100:00100000:0.0:1789776462.565432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666368 00000100:00100000:0.0:1789776462.565518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:0.0:1789776462.565530:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8733:x1876716432666368:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789776462.565725:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8733:x1876716432666368:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 196us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.565734:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:3.0:1789776462.576657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.576944:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666496 00000100:00100000:0.0:1789776462.576959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666496 00000100:00100000:0.0:1789776462.577041:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:0.0:1789776462.577054:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8741:x1876716432666496:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776462.577278:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8741:x1876716432666496:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 226us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.577288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:3.0:1789776462.582802:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776462.583556:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666624 00000100:00100000:1.0:1789776462.583570:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666624 00000100:00100000:1.0:1789776462.583644:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:1.0:1789776462.583656:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8741:x1876716432666624:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789776462.583877:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:8741:x1876716432666624:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 222us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776462.583992:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:3.0:1789776462.595827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.595881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.595961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.595989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776462.596138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667392 00000100:00100000:2.0:1789776462.596160:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667392 00000100:00100000:2.0:1789776462.596232:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667520 00000100:00100000:2.0:1789776462.596246:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667520 00000100:00100000:2.0:1789776462.596273:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666752 00000100:00100000:2.0:1789776462.596276:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666752 00000100:00100000:2.0:1789776462.596286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667008 00000100:00100000:2.0:1789776462.596288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667008 00000100:00100000:2.0:1789776462.596305:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1789776462.596319:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432667392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776462.596434:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432667392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 118us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.596442:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1789776462.596463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1789776462.596469:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432667520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776462.596526:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432667520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 56us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.596532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1789776462.596768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1789776462.596775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2410:x1876716432666752:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789776462.596819:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from da875f9e-f31d-49b9-bb9b-3e43b9776cb6@192.168.204.27@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1789776462.596874:0:6518:0:(genops.c:1385:class_connect()) connect: client da875f9e-f31d-49b9-bb9b-3e43b9776cb6, cookie 0xf13b8042cb884a9f 00000004:00100000:2.0:1789776462.596918:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789776462.597077:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776462.597113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2410:x1876716432666752:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 338us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.597120:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1789776462.597133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776462.597137:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2410:x1876716432667008:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789776462.597315:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from da875f9e-f31d-49b9-bb9b-3e43b9776cb6@192.168.204.27@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1789776462.597350:0:6518:0:(genops.c:1385:class_connect()) connect: client da875f9e-f31d-49b9-bb9b-3e43b9776cb6, cookie 0xf13b8042cb884aa6 00000004:00100000:2.0:1789776462.597417:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789776462.597528:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776462.597533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776462.598646:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776462.598713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2410:x1876716432667008:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 1572us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776462.598725:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1789776462.624616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.624708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.624739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.624787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432666880 00000100:00100000:0.0:1789776462.624800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432666880 00000100:00100000:0.0:1789776462.624889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667264 00000100:00100000:0.0:1789776462.624893:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667264 00000100:00100000:0.0:1789776462.624905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667136 00000100:00100000:0.0:1789776462.624907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667136 00000100:00100000:0.0:1789776462.624928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1789776462.624940:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+7:0:x1876716432666880:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776462.624994:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776462.625112:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+7:0:x1876716432666880:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 174us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.625120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1789776462.625153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1789776462.625169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432667264:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776462.625182:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776462.625218:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432667264:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 50us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.625224:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1789776462.625251:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1789776462.625266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:0:x1876716432667136:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776462.625284:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776462.625321:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:0:x1876716432667136:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 56us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.625328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00080000:3.0:1789776462.625847:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776462.625853:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776462.627901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.628711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667648 00000100:00100000:0.0:1789776462.628725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667648 00000100:00100000:0.0:1789776462.628804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776462.628817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432667648:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789776462.628941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432667648:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 127us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.628950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1789776462.636829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.636895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.636941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776462.637291:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668032 00000100:00100000:0.0:1789776462.637305:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668032 00000100:00100000:0.0:1789776462.637446:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1789776462.637460:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432668032:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789776462.637617:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432668032:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 161us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776462.637646:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1789776462.637720:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667776 00000100:00100000:1.0:1789776462.637725:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667776 00000100:00100000:1.0:1789776462.637750:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432667904 00000100:00100000:1.0:1789776462.637753:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432667904 00000100:00100000:1.0:1789776462.637769:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1789776462.637776:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1876716432667776:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776462.637809:0:8528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from da875f9e-f31d-49b9-bb9b-3e43b9776cb6@192.168.204.27@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1789776462.637853:0:8528:0:(genops.c:1385:class_connect()) connect: client da875f9e-f31d-49b9-bb9b-3e43b9776cb6, cookie 0xf13b8042cb884aad 00002000:00100000:1.0:1789776462.637870:0:8528:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da875f9e-f31d-49b9-bb9b-3e43b9776cb6/ffff8a5bc343d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776462.637884:0:8528:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776462.637983:0:8528:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789776462.638021:0:8528:0:(import.c:65:import_set_state_nolock()) ffff8a5bc343c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776462.638055:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2410:x1876716432667776:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 279us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776462.638062:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1789776462.638093:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1789776462.638106:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1876716432667904:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776462.638124:0:8528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from da875f9e-f31d-49b9-bb9b-3e43b9776cb6@192.168.204.27@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1789776462.638142:0:8528:0:(genops.c:1385:class_connect()) connect: client da875f9e-f31d-49b9-bb9b-3e43b9776cb6, cookie 0xf13b8042cb884ab4 00002000:00100000:1.0:1789776462.638147:0:8528:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da875f9e-f31d-49b9-bb9b-3e43b9776cb6/ffff8a5bc343b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776462.638153:0:8528:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776462.638201:0:8528:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789776462.638217:0:8528:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3438000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776462.638242:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2410:x1876716432667904:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 133us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776462.638249:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1789776462.648110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776462.648760:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668160 00000100:00100000:3.0:1789776462.648976:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668160 00000100:00100000:3.0:1789776462.649122:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1789776462.649136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432668160:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789776462.651343:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789776462.651454:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:8733:x1876716432668160:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 2316us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776462.651464:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00010000:00010000:1.0:1789776463.266959:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776464.290740:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776464.932076:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776464.932107:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449513856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776464.932205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776464.932315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513856 00000100:00100000:0.0:1789776464.932325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513856 00000100:00100000:0.0:1789776464.932388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776464.932399:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449513856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776464.932446:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776464.932521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449513856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776464.932528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776464.932587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449513856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776464.933010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449513984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776464.933044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776464.933148:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449513984 00000100:00100000:2.0:1789776464.933154:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449513984 00000100:00100000:2.0:1789776464.933198:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789776464.933206:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449513984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776464.933342:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776464.933394:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449513984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776464.933401:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776464.933487:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449513984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789776465.315454:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776466.340740:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776466.466961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449514112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776466.467039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776466.467118:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776466.467125:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449514240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776466.467152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.467281:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514112 00000100:00100000:1.0:1789776466.467289:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514112 00000100:00080000:0.0:1789776466.467338:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776466.467345:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514240 00000100:00100000:1.0:1789776466.467348:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514240 00000100:00100000:1.0:1789776466.467382:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776466.467391:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449514112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776466.467395:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776466.467403:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449514240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776466.467421:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789776466.467430:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776466.467708:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449514112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.467715:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789776466.468147:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776466.478027:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449514240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10615us (10862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776466.478042:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789776466.485909:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43f480 x1876716449514240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776466.485939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449514240:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789776466.485955:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff438700 x1876716449514112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776466.485967:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449514112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776466.978969:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449514624:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979099:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449515136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979142:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979178:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449515648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979229:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:1.0:1789776466.979236:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449514496:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979285:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449514368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776466.979310:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449515008:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979349:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979368:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449515520:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449516032:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776466.979457:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514624 00000100:00100000:1.0:1789776466.979464:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514624 00000100:00100000:1.0:1789776466.979526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515136 00000100:00100000:1.0:1789776466.979530:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515136 00000100:00100000:1.0:1789776466.979552:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515648 00000100:00100000:1.0:1789776466.979555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515648 00000100:00100000:1.0:1789776466.979571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789776466.979579:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449514624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979631:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449514624:12345-0@lo:400:kworker.0 Request processed in 52us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.979637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789776466.979667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789776466.979680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449515136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979725:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449515136:12345-0@lo:400:kworker.0 Request processed in 46us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.979732:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789776466.979746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789776466.979752:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449515648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979778:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449515648:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.979784:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789776466.979803:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515008 00000100:00100000:1.0:1789776466.979807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515008 00000100:00100000:1.0:1789776466.979830:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789776466.979837:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449515008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979882:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449515008:12345-0@lo:400:kworker.0 Request processed in 45us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.979888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789776466.979909:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515520 00000100:00100000:1.0:1789776466.979912:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515520 00000100:00100000:1.0:1789776466.979933:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516032 00000100:00100000:1.0:1789776466.979935:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516032 00000100:00100000:1.0:1789776466.979952:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776466.979958:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449515520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.979987:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449515520:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.979993:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776466.980005:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789776466.980010:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449516032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.980040:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449516032:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776466.980046:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789776466.980069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776466.980073:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776466.980097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449515008:0@lo:400:kworker.0 00010000:00080000:1.0:1789776466.980109:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3702a00 x1876716449515520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776466.980119:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449515520:0@lo:400:kworker.0 00010000:00080000:1.0:1789776466.980127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2f800 x1876716449516032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776466.980134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449516032:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.980144:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449514624:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.980151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449515136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776466.980159:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449515648:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.980746:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449514880:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.980790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776466.980833:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449515392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.981010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776466.981048:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449515904:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.981070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776466.981091:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789776466.981097:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449514752:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.981118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776466.981133:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449515264:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.981152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776466.981179:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449515776:0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.981202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776466.981218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514880 00000100:00100000:2.0:1789776466.981226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514880 00000100:00100000:3.0:1789776466.981232:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515264 00000100:00100000:3.0:1789776466.981237:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515264 00000100:00100000:2.0:1789776466.981256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515776 00000100:00100000:2.0:1789776466.981261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515776 00000100:00100000:3.0:1789776466.981275:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789776466.981319:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515392 00000100:00100000:0.0:1789776466.981325:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515392 00000100:00100000:0.0:1789776466.981353:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449515904 00000100:00100000:0.0:1789776466.981356:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449515904 00000100:00100000:0.0:1789776466.981370:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776466.981375:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449515392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.981424:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449515392:12345-0@lo:400:kworker.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776466.981432:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776466.981445:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776466.981452:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.981478:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449515904:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776466.981484:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789776466.981531:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3700a80 x1876716449515392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776466.981543:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449515392:0@lo:400:kworker.0 00010000:00080000:0.0:1789776466.981552:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ca80 x1876716449515904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776466.981559:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449515904:0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.981631:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514752 00000100:00100000:0.0:1789776466.981635:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514752 00000100:00100000:0.0:1789776466.981660:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789776466.981666:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449514752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.981699:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449514752:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776466.981704:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789776466.981805:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449514880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776466.982056:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449514880:12345-0@lo:400:kworker.0 Request processed in 560us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776466.982093:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514496 00000100:00100000:0.0:1789776466.982097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514496 00000100:00100000:0.0:1789776466.982125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789776466.982132:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.982163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449514496:12345-0@lo:400:kworker.0 Request processed in 31us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776466.982178:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789776466.982220:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449514752:0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.982231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449514880:0@lo:400:kworker.0 00000100:00100000:0.0:1789776466.982252:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449516160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776466.982281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776466.982309:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449514496:0@lo:400:kworker.0 00000100:00100000:2.0:1789776466.992260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789776466.992285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449515264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776466.992396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449515264:12345-0@lo:400:kworker.0 Request processed in 124us (11243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776466.992405:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789776466.992428:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789776466.992435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449515776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776466.992483:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449515776:12345-0@lo:400:kworker.0 Request processed in 49us (11281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776466.992490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1789776466.992576:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3700000 x1876716449515264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776466.992590:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449515264:0@lo:400:kworker.0 00010000:00080000:2.0:1789776466.992604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ed80 x1876716449515776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776466.992643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449515776:0@lo:400:kworker.0 00000100:00100000:2.0:1789776466.992695:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449514368 00000100:00100000:2.0:1789776466.992702:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449514368 00000100:00100000:2.0:1789776466.992735:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516160 00000100:00100000:2.0:1789776466.992739:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516160 00000100:00100000:2.0:1789776466.992754:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776466.992761:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449514368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776466.992783:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776466.992826:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449514368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (13515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776466.992833:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776466.992859:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776466.992866:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449516160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776466.992876:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776466.992901:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449516160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (10619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776466.992906:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789776466.992960:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776466.992965:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789776466.993085:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ca80 x1876716449516160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776466.993099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449516160:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789776466.993111:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff439880 x1876716449514368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776466.993121:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449514368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776467.001092:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:3.0:1789776467.362817:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776467.642800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776467.642844:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776467.643252:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776467.643293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776467.643311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776467.644366:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668288 00000100:00100000:0.0:1789776467.644379:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668288 00000100:00100000:0.0:1789776467.644459:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:0.0:1789776467.644469:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432668288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776467.644598:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432668288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 129us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776467.644606:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:0.0:1789776467.644660:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668928 00000100:00100000:0.0:1789776467.644665:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668928 00000100:00100000:0.0:1789776467.644710:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1789776467.644717:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776467.644748:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776467.644770:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00080000:0.0:1789776467.644787:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776467.657866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776467.658024:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668416 00000100:00100000:3.0:1789776467.658044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668416 00000100:00100000:3.0:1789776467.658104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668672 00000100:00100000:3.0:1789776467.658108:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668672 00000100:00100000:3.0:1789776467.658123:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668544 00000100:00100000:3.0:1789776467.658125:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668544 00000100:00100000:3.0:1789776467.658152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1789776467.658171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432668416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776467.658258:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432668416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 89us (15469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776467.658265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1789776467.658284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:3.0:1789776467.658290:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776467.658311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (15468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776467.658317:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:3.0:1789776467.658326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1789776467.658331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432668544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776467.658350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432668544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 19us (15038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776467.658355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00080000:3.0:1789776467.659046:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776467.659051:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776467.666392:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776467.666469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432668800 00000100:00100000:1.0:1789776467.666488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432668800 00000100:00080000:3.0:1789776467.666659:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776467.667308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1789776467.667323:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776467.667409:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432668800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (9555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776467.667586:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669056 00000100:00100000:2.0:1789776467.667593:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669056 00000100:00100000:2.0:1789776467.667764:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1789776467.667771:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432669056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776467.667799:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2413:x1876716432669056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776467.667805:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00080000:2.0:1789776467.667825:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776467.668372:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00010000:00010000:2.0:1789776468.387552:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789776468.531051:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00100000:2.0:1789776468.535380:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00100000:0.0:1789776468.545821:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00100000:0.0:1789776468.546969:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:02000400:3.0:1789776468.625379:0:12183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789776469.413526:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776470.050716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449516288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776470.050797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776470.051051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516288 00000100:00100000:1.0:1789776470.051059:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516288 00000100:00100000:1.0:1789776470.051104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789776470.051127:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7de0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449516288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776470.051161:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776470.051208:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7de0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449516288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776470.051215:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789776470.051529:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449516288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776470.051546:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776470.051552:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449516416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776470.051581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776470.051610:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516416 00000100:00100000:1.0:1789776470.051614:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516416 00000100:00100000:1.0:1789776470.051937:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789776470.051946:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449516416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776470.051967:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776470.052008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449516416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776470.052030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789776470.052063:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449516416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789776470.436536:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776471.458816:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776471.594668:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776471.594768:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776471.594912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516544 00000100:00100000:3.0:1789776471.594924:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516544 00000100:00100000:3.0:1789776471.595006:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789776471.595019:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449516544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776471.595059:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776471.595127:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449516544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776471.595149:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789776471.595475:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789776471.595544:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2ed80 x1876716449516544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776471.595568:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776471.595915:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449516672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776471.595962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776471.596010:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516672 00000100:00100000:2.0:1789776471.596014:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516672 00000100:00100000:2.0:1789776471.596051:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789776471.596058:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449516672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776471.596075:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776471.596127:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449516672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776471.596134:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789776471.596161:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43f100 x1876716449516672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776471.596174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449516672:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789776471.596295:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776472.098717:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449516800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776472.098830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.098928:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516800 00000100:00100000:2.0:1789776472.098940:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516800 00000100:00100000:2.0:1789776472.099011:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789776472.099023:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449516800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776472.099061:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776472.099131:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449516800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.099140:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789776472.099167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789776472.099209:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43f100 x1876716449516800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776472.099233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449516800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776472.099452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776472.099481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.103872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449517056:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.103984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104044:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449517568:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104111:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449518080:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104168:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789776472.104175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449517184:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104229:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449517696:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104348:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517568 00000100:00100000:2.0:1789776472.104358:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517568 00000100:00100000:2.0:1789776472.104417:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789776472.104427:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104515:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449517568:12345-0@lo:400:kworker.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.104522:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789776472.104552:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518080 00000100:00100000:2.0:1789776472.104556:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518080 00000100:00100000:2.0:1789776472.104587:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776472.104594:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104627:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449518080:12345-0@lo:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.104634:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776472.104651:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517184 00000100:00100000:2.0:1789776472.104655:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517184 00000100:00100000:2.0:1789776472.104694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517696 00000100:00100000:2.0:1789776472.104697:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517696 00000100:00100000:2.0:1789776472.104719:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518208 00000100:00100000:2.0:1789776472.104721:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518208 00000100:00100000:2.0:1789776472.104733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789776472.104738:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449517184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449517184:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.104779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789776472.104791:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789776472.104796:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449517696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104818:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449517696:12345-0@lo:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.104823:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789776472.104830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789776472.104835:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449518208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104857:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449518208:12345-0@lo:400:kworker.0 Request processed in 22us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.104862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789776472.104886:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776472.104905:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449517440:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449517952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.104974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.104994:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789776472.104999:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449517312:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.105042:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449517824:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.105091:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449518336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776472.105135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517952 00000100:00100000:2.0:1789776472.105144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517952 00000100:00100000:2.0:1789776472.105171:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776472.105177:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105212:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449517952:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.105218:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776472.105235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517312 00000100:00100000:2.0:1789776472.105238:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517312 00000100:00100000:2.0:1789776472.105261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789776472.105267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449517312:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.105302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789776472.105323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517440 00000100:00100000:2.0:1789776472.105326:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517440 00000100:00100000:2.0:1789776472.105341:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517824 00000100:00100000:2.0:1789776472.105343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517824 00000100:00100000:2.0:1789776472.105362:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518336 00000100:00100000:2.0:1789776472.105365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518336 00000100:00100000:2.0:1789776472.105379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789776472.105385:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449517440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449517440:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.105423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789776472.105436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789776472.105442:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449517824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105468:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449517824:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.105485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789776472.105522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789776472.105529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449518336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449518336:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776472.105565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789776472.105580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776472.105625:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449517312:0@lo:400:kworker.0 00010000:00080000:2.0:1789776472.105639:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3796680 x1876716449517824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776472.105650:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449517824:0@lo:400:kworker.0 00010000:00080000:2.0:1789776472.105659:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3796300 x1876716449518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776472.105666:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449518336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105675:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449517440:0@lo:400:kworker.0 00010000:00080000:2.0:1789776472.105682:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3797b80 x1876716449517952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776472.105691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449517952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105731:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449517184:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105741:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449517696:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789776472.105772:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449517568:0@lo:400:kworker.0 00010000:00080000:2.0:1789776472.105785:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3794e00 x1876716449518080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776472.105794:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449518080:0@lo:400:kworker.0 00000100:00100000:3.0:1789776472.106141:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449516928 00000100:00100000:3.0:1789776472.106148:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449516928 00000100:00100000:3.0:1789776472.106207:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789776472.106216:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449516928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776472.106237:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776472.106289:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449516928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (6807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776472.106296:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789776472.106329:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff458000 x1876716449516928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776472.106347:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449516928:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789776472.106472:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776472.106580:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449517056 00000100:00100000:0.0:1789776472.106586:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449517056 00000100:00100000:0.0:1789776472.106625:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789776472.106633:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449517056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776472.106678:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449517056:12345-0@lo:400:kworker.0 Request processed in 47us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.106685:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789776472.106730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449517056:0@lo:400:kworker.0 00010000:00010000:1.0:1789776472.483044:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776472.772355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.772414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776472.772488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669312 00000100:00100000:3.0:1789776472.772530:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669312 00000100:00100000:1.0:1789776472.772539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669184 00000100:00100000:1.0:1789776472.772551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669184 00000100:00100000:1.0:1789776472.772612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:3.0:1789776472.772632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:1.0:1789776472.772633:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432669184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776472.772652:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432669312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776472.772722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432669184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776472.772731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:3.0:1789776472.773385:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432669312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 734us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776472.773397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00080000:0.0:1789776472.773451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776472.775893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.775928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.775954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.775976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.776186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776472.776234:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669440 00000100:00100000:0.0:1789776472.776245:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669440 00000100:00100000:0.0:1789776472.776317:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669568 00000100:00100000:0.0:1789776472.776323:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669568 00000100:00100000:0.0:1789776472.776355:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669696 00000100:00100000:0.0:1789776472.776359:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669696 00000100:00100000:0.0:1789776472.776375:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:0.0:1789776472.776384:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432669440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776472.776458:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432669440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 74us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.776466:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:0.0:1789776472.776483:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:0.0:1789776472.776489:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776472.776539:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.776545:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:0.0:1789776472.776558:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1789776472.776564:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776472.776589:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.776595:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1789776472.776618:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669824 00000100:00100000:0.0:1789776472.776622:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669824 00000100:00100000:0.0:1789776472.776674:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432669952 00000100:00100000:0.0:1789776472.776678:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432669952 00000100:00100000:0.0:1789776472.776708:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1789776472.776715:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776472.776742:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.776758:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1789776472.776775:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1789776472.776786:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776472.776817:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432669952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776472.776823:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00080000:0.0:1789776472.776970:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776472.776974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776472.776977:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776472.776978:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789776473.507209:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776474.533392:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776475.170756:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776475.171001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776475.171132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518464 00000100:00100000:1.0:1789776475.171143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518464 00000100:00100000:1.0:1789776475.171212:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776475.171223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776475.171262:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776475.171332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776475.171351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789776475.171413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776475.171614:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776475.171630:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449518592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776475.171670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776475.171717:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518592 00000100:00100000:2.0:1789776475.171723:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518592 00000100:00100000:2.0:1789776475.171751:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776475.171757:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449518592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776475.171780:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776475.171816:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449518592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776475.171822:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776475.171874:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449518592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789776475.564196:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789776476.579462:0:12499:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776476.579909:0:12499:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776476.580374:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776476.710174:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449518720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776476.710249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776476.710395:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518720 00000100:00100000:1.0:1789776476.710405:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518720 00000100:00100000:1.0:1789776476.710465:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776476.710474:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449518720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776476.710519:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776476.710562:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449518720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776476.710568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789776476.711109:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789776476.711242:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0ad80 x1876716449518720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776476.711263:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449518720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776476.715303:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776476.715328:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776476.715429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776476.715486:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518848 00000100:00100000:3.0:1789776476.715509:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518848 00000100:00100000:3.0:1789776476.715567:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789776476.715588:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776476.715613:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776476.715658:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776476.715665:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789776476.715705:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc81f6d80 x1876716449518848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776476.715727:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518848:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789776476.717793:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776477.218615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776477.218739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.218798:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449519488:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.218827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.218848:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449520000:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.218905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776477.218906:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449519232:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.218937:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449520512:0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.218937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.218959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776477.218959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449519744:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.218998:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789776477.219005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449519360:0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.219056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.219059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.219077:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449519872:0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.219077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449520256:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.219100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776477.219106:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449519104:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.219121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449520384:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.219142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.219171:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519488 00000100:00100000:2.0:1789776477.219178:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519488 00000100:00100000:2.0:1789776477.219213:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519232 00000100:00100000:2.0:1789776477.219216:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519232 00000100:00100000:2.0:1789776477.219230:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519744 00000100:00100000:2.0:1789776477.219233:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519744 00000100:00100000:0.0:1789776477.219257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.219258:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519872 00000100:00100000:2.0:1789776477.219260:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519872 00000100:00100000:2.0:1789776477.219273:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520384 00000100:00100000:2.0:1789776477.219276:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520384 00000100:00100000:0.0:1789776477.219285:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449519616:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.219291:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789776477.219299:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.219307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776477.219325:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520128:0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.219329:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449518976 00000100:00100000:1.0:1789776477.219336:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449518976 00000100:00100000:0.0:1789776477.219345:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.219350:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449519488:12345-0@lo:400:kworker.0 Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776477.219358:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789776477.219374:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789776477.219378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789776477.219381:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449519232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.219385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449519744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.219401:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776477.219413:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776477.219423:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449519232:12345-0@lo:400:kworker.0 Request processed in 42us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776477.219430:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:1.0:1789776477.219441:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776477.219447:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789776477.219456:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449519872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.219515:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449518976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776477.219521:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449519872:12345-0@lo:400:kworker.0 Request processed in 65us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776477.219522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449519744:12345-0@lo:400:kworker.0 Request processed in 137us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.219532:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776477.219533:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789776477.219722:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519360 00000100:00100000:1.0:1789776477.219727:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519360 00000100:00100000:1.0:1789776477.219756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519616 00000100:00100000:1.0:1789776477.219760:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519616 00000100:00100000:1.0:1789776477.219773:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789776477.219780:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449519360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.219818:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449519360:12345-0@lo:400:kworker.0 Request processed in 38us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.219826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789776477.219842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789776477.219848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449519616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.219881:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449519616:12345-0@lo:400:kworker.0 Request processed in 33us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.219888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789776477.220122:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520000 00000100:00100000:3.0:1789776477.220127:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520000 00000100:00100000:3.0:1789776477.220157:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520512 00000100:00100000:3.0:1789776477.220159:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520512 00000100:00100000:3.0:1789776477.220176:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520128 00000100:00100000:3.0:1789776477.220179:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520128 00000100:00100000:3.0:1789776477.220196:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776477.220202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449520000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776477.220272:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449520000:12345-0@lo:400:kworker.0 Request processed in 70us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.220278:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776477.220293:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776477.220301:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776477.220345:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449520512:12345-0@lo:400:kworker.0 Request processed in 46us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.220352:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776477.220365:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776477.220371:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776477.220398:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520128:12345-0@lo:400:kworker.0 Request processed in 28us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.220404:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776477.220424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449519104 00000100:00100000:3.0:1789776477.220428:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449519104 00000100:00100000:3.0:1789776477.220453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789776477.220460:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776477.220513:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449519104:12345-0@lo:400:kworker.0 Request processed in 33us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.220520:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789776477.221300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789776477.221307:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789776477.221320:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.221363:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449520384:12345-0@lo:400:kworker.0 Request processed in 48us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776477.221369:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789776477.221379:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520640:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789776477.221395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776477.221400:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776477.221402:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776477.221419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776477.221425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776477.221462:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449519232:0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.221462:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449519104:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.221476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449519744:0@lo:400:kworker.0 00000100:00100000:0.0:1789776477.221476:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449519616:0@lo:400:kworker.0 00010000:00080000:0.0:1789776477.221489:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff34ad80 x1876716449520128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776477.221515:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520128:0@lo:400:kworker.0 00000100:00100000:3.0:1789776477.221535:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520640 00000100:00100000:3.0:1789776477.221541:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520640 00000100:00100000:3.0:1789776477.221579:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789776477.221587:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776477.221601:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776477.221705:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.221711:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789776477.221736:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff45aa00 x1876716449520640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776477.221751:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776477.221873:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449519360:0@lo:400:kworker.0 00010000:00080000:2.0:1789776477.221886:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff349180 x1876716449519872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776477.221894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449519872:0@lo:400:kworker.0 00010000:00080000:2.0:1789776477.221904:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff34b100 x1876716449520384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776477.221919:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449520384:0@lo:400:kworker.0 00010000:00080000:2.0:1789776477.221934:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e7800 x1876716449520512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776477.221940:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449520512:0@lo:400:kworker.0 00000100:00100000:2.0:1789776477.221951:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449519488:0@lo:400:kworker.0 00010000:00080000:2.0:1789776477.221963:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff349880 x1876716449520000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776477.221984:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449520000:0@lo:400:kworker.0 00010000:00080000:2.0:1789776477.221998:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff439880 x1876716449518976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776477.222012:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449518976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776477.227096:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520256 00000100:00100000:1.0:1789776477.227112:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520256 00000100:00100000:1.0:1789776477.227183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789776477.227194:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449520256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776477.227289:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449520256:12345-0@lo:400:kworker.0 Request processed in 98us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.227296:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1789776477.227335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776477.227372:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449520256:0@lo:400:kworker.0 00010000:00010000:1.0:1789776477.602696:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776477.892189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892330:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776477.892544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670336 00000100:00100000:1.0:1789776477.892555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670336 00000100:00100000:1.0:1789776477.892611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670592 00000100:00100000:1.0:1789776477.892615:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670592 00000100:00100000:1.0:1789776477.892629:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670208 00000100:00100000:1.0:1789776477.892631:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670208 00000100:00100000:1.0:1789776477.892644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670464 00000100:00100000:1.0:1789776477.892646:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670464 00000100:00100000:1.0:1789776477.892662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:1.0:1789776477.892673:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432670336:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776477.892753:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432670336:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 81us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.892761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:3.0:1789776477.892789:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:3.0:1789776477.892798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776477.892826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776477.892845:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670080 00000100:00100000:0.0:1789776477.892850:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670080 00000100:00100000:0.0:1789776477.892887:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:0.0:1789776477.892897:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432670080:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776477.892927:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432670080:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776477.893141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:1.0:1789776477.895398:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:1.0:1789776477.895418:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432670208:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776477.895511:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432670208:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 101us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.895520:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:1.0:1789776477.895560:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:1.0:1789776477.895568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776477.895597:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776477.895622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00080000:1.0:1789776477.895644:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776477.895649:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776477.896219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:3.0:1789776477.896250:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670848 00000100:00100000:3.0:1789776477.896258:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670848 00000100:00100000:3.0:1789776477.896446:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670720 00000100:00100000:3.0:1789776477.896450:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670720 00000100:00100000:3.0:1789776477.896471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1789776477.896478:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:1.0:1789776477.899610:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776477.899620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776477.899659:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 100us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.899675:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1789776477.899709:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1789776477.899726:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776477.899804:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432670720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 82us (7307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776477.899812:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000020:00000004:1.0:1789776478.322295:0:12596:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776478.322580:0:12596:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789776478.626937:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776479.653280:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789776480.212784:0:12693:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776480.213048:0:12693:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789776480.291293:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776480.291316:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776480.291388:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776480.291466:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520768 00000100:00100000:0.0:1789776480.291473:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520768 00000100:00100000:0.0:1789776480.291545:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789776480.291555:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776480.291599:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776480.291707:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449520768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776480.291715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789776480.291765:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449520768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776480.292258:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776480.292275:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449520896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776480.292374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776480.292557:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449520896 00000100:00100000:2.0:1789776480.292564:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449520896 00000100:00100000:2.0:1789776480.292604:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789776480.292612:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449520896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776480.292636:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776480.292688:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449520896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776480.292695:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789776480.292806:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449520896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789776480.677483:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776481.699654:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776481.828659:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776481.828687:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449521024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776481.828767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776481.828838:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521024 00000100:00100000:1.0:1789776481.828846:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521024 00000100:00100000:1.0:1789776481.828915:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776481.828926:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cef17c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449521024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776481.828956:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776481.829003:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cef17c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449521024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776481.829010:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789776481.829241:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc81f4380 x1876716449521024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776481.829252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776481.829262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449521024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776481.830531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776481.830563:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449521152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776481.830620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776481.830671:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521152 00000100:00100000:3.0:1789776481.830678:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521152 00000100:00080000:0.0:1789776481.830729:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776481.830750:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776481.830761:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449521152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776481.830783:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776481.830836:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449521152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776481.830843:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789776481.830892:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc81f4380 x1876716449521152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776481.830917:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449521152:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1789776482.004474:0:12791:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776482.005004:0:12791:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789776482.338741:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449521408:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.338816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.338881:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449521920:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.338906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.338931:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449522432:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.338957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.338981:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789776482.338988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449521536:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.339010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.339027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449522048:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.339046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.339063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449522560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.339085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.339121:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521408 00000100:00100000:0.0:1789776482.339129:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521408 00000100:00100000:0.0:1789776482.339169:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521920 00000100:00100000:0.0:1789776482.339173:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521920 00000100:00100000:0.0:1789776482.339207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522048 00000100:00100000:0.0:1789776482.339211:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522048 00000100:00100000:0.0:1789776482.339227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789776482.339242:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449521408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.339293:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449521408:12345-0@lo:400:kworker.0 Request processed in 52us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.339696:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.339736:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776482.339749:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449522176:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.339768:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776482.339780:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789776482.339786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449521280:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.339812:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776482.339835:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449521792:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.339853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776482.339882:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.339904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776482.339950:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521280 00000100:00100000:2.0:1789776482.339954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521280 00000100:00100000:2.0:1789776482.339983:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789776482.339990:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449521280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.340022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449521280:12345-0@lo:400:kworker.0 Request processed in 34us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.340028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789776482.340057:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521536 00000100:00100000:2.0:1789776482.340061:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521536 00000100:00100000:2.0:1789776482.340083:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521792 00000100:00100000:2.0:1789776482.340086:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521792 00000100:00100000:2.0:1789776482.340099:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776482.340105:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449521536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.340137:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449521536:12345-0@lo:400:kworker.0 Request processed in 33us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.340143:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776482.340163:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789776482.340169:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449521792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.340702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789776482.340720:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449521664 00000100:00100000:0.0:1789776482.340723:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449521664 00000100:00100000:0.0:1789776482.340737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522176 00000100:00100000:0.0:1789776482.340740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522176 00000100:00100000:0.0:1789776482.340751:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522304 00000100:00100000:0.0:1789776482.340754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522304 00000100:00100000:0.0:1789776482.340765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789776482.340771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.340807:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449521920:12345-0@lo:400:kworker.0 Request processed in 37us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.340813:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789776482.340823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789776482.340828:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.340852:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449522048:12345-0@lo:400:kworker.0 Request processed in 24us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.340857:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789776482.340866:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789776482.340883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449521664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.340910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449521664:12345-0@lo:400:kworker.0 Request processed in 39us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.340916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789776482.340923:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776482.340929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789776482.340936:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449522176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776482.340940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449522688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776482.340981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449522176:12345-0@lo:400:kworker.0 Request processed in 44us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.340987:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789776482.341003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789776482.341005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.341013:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449522304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776482.341044:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449522304:12345-0@lo:400:kworker.0 Request processed in 35us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.341050:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789776482.341074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522432 00000100:00100000:0.0:1789776482.341079:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522432 00000100:00100000:3.0:1789776482.341105:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522688 00000100:00100000:0.0:1789776482.341110:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522560 00000100:00100000:3.0:1789776482.341111:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522688 00000100:00100000:0.0:1789776482.341116:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522560 00000100:00100000:0.0:1789776482.341142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789776482.341149:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449522432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776482.341155:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789776482.341166:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876716449522688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789776482.341190:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776482.341231:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876716449522688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776482.341238:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789776482.341267:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449522816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776482.341299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776482.341385:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449522432:12345-0@lo:400:kworker.0 Request processed in 34us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.341395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789776482.341409:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789776482.341415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449522560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789776482.342203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776482.342210:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776482.342212:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776482.342297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449521536:0@lo:400:kworker.0 00010000:00080000:1.0:1789776482.342316:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e6680 x1876716449522048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776482.342327:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449522048:0@lo:400:kworker.0 00000100:00100000:1.0:1789776482.342342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449521408:0@lo:400:kworker.0 00000100:00100000:1.0:1789776482.342355:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449521920:0@lo:400:kworker.0 00010000:00080000:1.0:1789776482.342366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e5500 x1876716449522432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776482.342375:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449522432:0@lo:400:kworker.0 00010000:00080000:3.0:1789776482.344467:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43ca80 x1876716449522688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776482.346152:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449521792:12345-0@lo:400:kworker.0 Request processed in 5974us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.346167:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789776482.346234:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522816 00000100:00100000:2.0:1789776482.346247:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522816 00000100:00100000:2.0:1789776482.346315:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776482.346325:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449522816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776482.346351:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776482.346420:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449522816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.346427:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776482.346482:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449521280:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.346516:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449521792:0@lo:400:kworker.0 00010000:00080000:2.0:1789776482.346532:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e4380 x1876716449522304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776482.346543:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.346570:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789776482.346583:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449522176:0@lo:400:kworker.0 00000100:00100000:3.0:1789776482.347128:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449522688:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789776482.347163:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3c1d180 x1876716449522816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776482.347177:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449522816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776482.349416:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449522560:12345-0@lo:400:kworker.0 Request processed in 7993us (10322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776482.349432:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789776482.349640:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e5c00 x1876716449522560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776482.349656:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449522560:0@lo:400:kworker.0 00010000:00010000:2.0:1789776482.723327:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776483.006208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776483.006255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776483.006292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776483.006303:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671616 00000100:00100000:1.0:1789776483.006314:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671616 00000100:00100000:0.0:1789776483.006330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776483.006369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776483.006380:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1789776483.006392:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2410:x1876716432671616:12345-192.168.204.27@tcp:9:kworker.0 00000100:00100000:0.0:1789776483.006405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000020:00000080:1.0:1789776483.006421:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884aad 00000100:00080000:1.0:1789776483.006432:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5bc343c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789776483.006433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671104 00000100:00100000:0.0:1789776483.006438:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671104 00000100:00100000:0.0:1789776483.006472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671360 00000100:00100000:0.0:1789776483.006476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671360 00000001:00000004:1.0:1789776483.006490:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789776483.006518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671232 00000100:00100000:0.0:1789776483.006522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671232 00000100:00100000:0.0:1789776483.006544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671488 00000100:00100000:0.0:1789776483.006546:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671488 00000100:00100000:0.0:1789776483.006565:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:0.0:1789776483.006575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432671104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776483.006655:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432671104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776483.006656:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+2:2410:x1876716432671616:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 262us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776483.006673:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1789776483.006673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:0.0:1789776483.006695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:0.0:1789776483.006704:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432671360:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:1.0:1789776483.006728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776483.006733:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776483.006736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432671360:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00080000:1.0:1789776483.006737:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776483.006747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:1.0:1789776483.006761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:1.0:1789776483.006770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432671232:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776483.006805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432671232:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776483.008662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776483.009522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:0.0:1789776483.009544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432671488:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776483.009625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432671488:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776483.009633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:0.0:1789776483.009675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432670976 00000100:00100000:0.0:1789776483.009696:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432670976 00000100:00100000:0.0:1789776483.009732:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00100000:0.0:1789776483.009738:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432670976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776483.009766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432670976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776483.009774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00100000:1.0:1789776483.010524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00010000:00010000:1.0:1789776483.010563:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776483.010655:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671744 00000100:00100000:1.0:1789776483.010662:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671744 00000100:00100000:1.0:1789776483.010781:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1789776483.010790:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2410:x1876716432671744:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:1.0:1789776483.010820:0:8528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884ab4 00000100:00080000:1.0:1789776483.010829:0:8528:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3438000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789776483.010884:0:8528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789776483.011037:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+2:2410:x1876716432671744:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 248us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776483.011046:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00010000:00010000:1.0:1789776483.011082:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789776483.011090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789776483.748151:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776483.990342:0:12888:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776483.993262:0:12888:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776484.770614:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776485.412747:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449522944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776485.412856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776485.413160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449522944 00000100:00100000:0.0:1789776485.413169:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449522944 00000100:00100000:0.0:1789776485.413221:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789776485.413231:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449522944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776485.413269:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776485.413333:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449522944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776485.413341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789776485.414597:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449522944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776485.414636:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776485.414646:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776485.414699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776485.414876:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523072 00000100:00100000:2.0:1789776485.414883:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523072 00000100:00100000:2.0:1789776485.414934:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776485.414943:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776485.414975:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776485.415034:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776485.415041:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789776485.415266:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789776485.796892:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776486.820064:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776486.948036:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449523328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776486.948173:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449523200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776486.948186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776486.948213:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776486.948278:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523328 00000100:00100000:0.0:1789776486.948286:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523328 00000100:00100000:0.0:1789776486.948346:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523200 00000100:00100000:0.0:1789776486.948349:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523200 00000100:00100000:0.0:1789776486.948369:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789776486.948378:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449523328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776486.948406:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789776486.948411:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776486.948438:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776486.948447:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449523200:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776486.948454:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449523328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (268us total) trans 0 rc 0/0 00002000:00000024:3.0:1789776486.948459:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776486.948461:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789776486.948483:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449523200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776486.948489:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789776486.948532:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff348700 x1876716449523328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776486.948566:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449523328:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789776486.952520:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc81f4e00 x1876716449523200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776486.952669:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449523200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776487.459077:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449523456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776487.459146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776487.459217:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523456 00000100:00100000:3.0:1789776487.459224:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523456 00000100:00100000:3.0:1789776487.459275:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789776487.459292:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449523456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776487.459323:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776487.459367:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449523456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.459375:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789776487.459396:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789776487.459426:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3c1f100 x1876716449523456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776487.459445:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449523456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776487.459461:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776487.459467:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776487.459512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776487.459531:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523584 00000100:00100000:2.0:1789776487.459535:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523584 00000100:00100000:2.0:1789776487.459577:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789776487.459583:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776487.459594:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776487.459625:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.459631:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789776487.459648:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449523712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776487.459667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449523840:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.459677:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776487.459698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776487.459699:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449524224:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.459725:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776487.459725:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449524352:0@lo:400:kworker.0 00000100:00100000:0.0:1789776487.459733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523840 00000100:00100000:0.0:1789776487.459739:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523840 00000100:00100000:1.0:1789776487.459749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776487.459752:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449524736:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.459791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776487.459804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524352 00000100:00100000:0.0:1789776487.459809:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524352 00000100:00100000:2.0:1789776487.459817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449524096:0@lo:400:kworker.0 00000100:00080000:3.0:1789776487.459833:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776487.459841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776487.459845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523968:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.459851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449524608:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.459868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776487.459868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776487.459883:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449524480:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.459887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523712 00000100:00100000:2.0:1789776487.459890:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523712 00000100:00100000:3.0:1789776487.459903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776487.459916:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00010000:00080000:3.0:1789776487.459919:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff43e680 x1876716449523584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776487.459922:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449523712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.459932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776487.459955:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449523712:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.459962:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789776487.459965:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524736 00000100:00100000:3.0:1789776487.459968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524736 00000100:00100000:2.0:1789776487.459985:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524224 00000100:00100000:3.0:1789776487.459988:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524096 00000100:00100000:2.0:1789776487.459988:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524224 00000100:00100000:3.0:1789776487.459990:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524096 00000100:00100000:3.0:1789776487.459998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524608 00000100:00100000:3.0:1789776487.460000:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524608 00000100:00100000:2.0:1789776487.460007:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449523968 00000100:00100000:2.0:1789776487.460009:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449523968 00000100:00100000:3.0:1789776487.460020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524480 00000100:00100000:2.0:1789776487.460020:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776487.460022:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524480 00000100:00100000:2.0:1789776487.460026:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449524224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460035:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789776487.460041:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449523840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.460055:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449524224:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.460062:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776487.460070:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449523840:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.460073:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789776487.460076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789776487.460078:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460087:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789776487.460092:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449524736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.460108:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449523968:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.460113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449524736:12345-0@lo:400:kworker.0 Request processed in 22us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.460119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789776487.460122:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789776487.460133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789776487.460141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449524096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776487.460153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00010000:00080000:2.0:1789776487.460156:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e4a80 x1876716449524736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776487.460167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449524608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.460170:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449524736:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460173:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449524096:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.460180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789776487.460183:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449523712:0@lo:400:kworker.0 00000100:00100000:2.0:1789776487.460192:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449524224:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460194:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789776487.460201:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449524480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776487.460220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449524608:12345-0@lo:400:kworker.0 Request processed in 57us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776487.460228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789776487.460236:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449524480:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.460243:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789776487.460258:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789776487.460265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449524352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460291:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449524352:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776487.460303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1789776487.460325:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776487.460327:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776487.460345:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449523968:0@lo:400:kworker.0 00010000:00080000:3.0:1789776487.460359:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e4380 x1876716449524480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776487.460367:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449524480:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460395:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449524096:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449524608:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449523840:0@lo:400:kworker.0 00000100:00100000:3.0:1789776487.460431:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449524352:0@lo:400:kworker.0 00000001:02000400:2.0:1789776487.587442:0:13032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789776487.843124:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776488.127992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776488.128038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776488.128069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776488.128101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776488.128125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776488.128167:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672000 00000100:00100000:1.0:1789776488.128176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672000 00000100:00100000:1.0:1789776488.128227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672128 00000100:00100000:1.0:1789776488.128231:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672128 00000100:00100000:1.0:1789776488.128246:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672256 00000100:00100000:1.0:1789776488.128249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672256 00000100:00100000:1.0:1789776488.128260:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672384 00000100:00100000:1.0:1789776488.128263:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672384 00000100:00100000:1.0:1789776488.128279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:1.0:1789776488.128288:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432672000:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776488.128363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432672000:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776488.128371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1789776488.128548:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1789776488.128558:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432672128:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776488.128588:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432672128:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776488.128593:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1789776488.128610:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1789776488.128615:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432672256:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776488.128638:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432672256:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776488.128644:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1789776488.128675:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:3.0:1789776488.128681:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432672384:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776488.128708:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432672384:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776488.128714:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00080000:3.0:1789776488.128735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776488.128739:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776488.128824:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432671872 00000100:00100000:2.0:1789776488.128829:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432671872 00000100:00100000:2.0:1789776488.128869:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 310 00000100:00100000:2.0:1789776488.128877:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432671872:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776488.128902:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432671872:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776488.128908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 310 00000001:00100000:0.0:1789776488.493312:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000020:00000080:0.0:1789776488.493324:0:9510:0:(genops.c:885:class_export_put()) final put ffff8a5bc343b000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000020:00000080:3.0:1789776488.493483:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc343b000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 for lustre-OST0001 00000020:00000080:3.0:1789776488.493575:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc3438000 for lustre-OST0001 00000001:00100000:1.0:1789776488.493893:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000020:00000080:1.0:1789776488.493898:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5bc343d000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000020:00000080:0.0:1789776488.494011:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc343d000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 for lustre-OST0000 00000020:00000080:0.0:1789776488.494052:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc343c000 for lustre-OST0000 00010000:00010000:0.0:1789776488.868170:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776489.890962:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776490.530796:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776490.530822:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449524864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776490.530900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776490.531084:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524864 00000100:00100000:1.0:1789776490.531093:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524864 00000100:00100000:1.0:1789776490.531150:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789776490.531174:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449524864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776490.531212:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776490.531264:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449524864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776490.531272:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789776490.531412:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449524864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776490.535469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449524992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776490.535579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776490.535706:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449524992 00000100:00100000:1.0:1789776490.535725:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449524992 00000100:00100000:1.0:1789776490.535774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789776490.535784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449524992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776490.535823:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776490.535887:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449524992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776490.535895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789776490.536096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449524992:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1789776490.735594:0:13180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb35cceb0 20000000:00000080:3.0:1789776490.735613:0:13180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cff370400 uarg=0000000000000000 20000000:01000000:3.0:1789776490.735659:0:13180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789776490.735666:0:13180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789776490.735671:0:13180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789776490.738360:0:13181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789776490.738678:0:13180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789776490.746086:0:13180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776490.746122:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746145:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746154:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746162:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746185:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746196:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746205:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746214:0:13180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746264:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.746282:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 12 pid: 6509 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.746306:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525120:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776490.747104:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747119:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.747131:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525248:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776490.747225:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747248:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 23 pid: 6510 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.747257:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525376:0@lo:104: 00000100:00100000:0.0:1789776490.747296:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776490.747328:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747336:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 23 pid: 6509 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.747343:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525504:0@lo:104: 00000100:00100000:0.0:1789776490.747364:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776490.747389:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747397:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 23 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.747405:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2696300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525632:0@lo:104: 00000100:00100000:0.0:1789776490.747425:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776490.747442:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747450:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 23 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.747458:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525760:0@lo:104: 00000100:00100000:0.0:1789776490.747487:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776490.747529:0:13180:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776490.747571:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449525376 00000100:00100000:0.0:1789776490.747580:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449525376 00000100:00100000:0.0:1789776490.747617:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449525504 00000100:00100000:0.0:1789776490.747619:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449525504 00000100:00100000:0.0:1789776490.747629:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449525632 00000100:00100000:0.0:1789776490.747632:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449525632 00000100:00100000:0.0:1789776490.747640:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449525760 00000100:00100000:0.0:1789776490.747642:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449525760 00000100:00100000:0.0:1789776490.747653:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789776490.747661:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:13180:x1876716449525376:12345-0@lo:104: 00010000:00010000:0.0:1789776490.747673:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747738:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776490.747744:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+6:13180:x1876716449525376:12345-0@lo:104: Request processed in 83us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776490.747751:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789776490.747767:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776490.747773:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:13180:x1876716449525504:12345-0@lo:104: 00010000:00010000:0.0:1789776490.747780:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747812:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789776490.747817:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:13180:x1876716449525504:12345-0@lo:104: Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776490.747822:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776490.747834:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776490.747846:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:13180:x1876716449525632:12345-0@lo:104: 00010000:00010000:0.0:1789776490.747853:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.747899:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789776490.747904:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:13180:x1876716449525632:12345-0@lo:104: Request processed in 60us (479us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776490.748247:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776490.748256:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748264:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776490.748274:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748283:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776490.748290:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776490.748296:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776490.748340:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748347:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776490.748370:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748376:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c400/0xf13b8042cb884a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748389:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776490.748392:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748399:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776490.748402:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748409:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776490.748427:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776490.748432:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776490.748448:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748454:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776490.748469:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748476:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c000/0xf13b8042cb884a67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748487:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776490.748526:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748533:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776490.748536:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748544:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776490.748550:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776490.748557:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776490.748579:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748586:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776490.748593:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748599:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342c600/0xf13b8042cb884a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.748610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776490.748612:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776490.748614:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776490.748627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449525888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.748662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776490.748700:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449526016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.749092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776490.749144:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776490.749151:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449526144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.749172:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776490.749203:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449525888 00000100:00100000:2.0:1789776490.749208:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449525888 00010000:00010000:2.0:1789776490.749245:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 24 pid: 6510 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776490.749265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526016 00000100:00100000:2.0:1789776490.749268:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526016 00010000:00010000:2.0:1789776490.749278:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 25 pid: 6509 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776490.749301:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526144 00000100:00100000:2.0:1789776490.749303:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526144 00010000:00010000:2.0:1789776490.749312:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 26 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776490.749323:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776490.749329:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+26:3646:x1876716449525888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776490.749340:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776490.749344:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 26 pid: 6510 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749354:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 26 pid: 6510 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749371:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776490.749400:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+26:3646:x1876716449525888:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776490.749406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776490.749419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776490.749425:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3643:x1876716449526016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776490.749431:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776490.749435:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 25 pid: 6509 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749443:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 25 pid: 6509 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749452:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776490.749482:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3643:x1876716449526016:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776490.749487:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776490.749541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776490.749547:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449526144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776490.749554:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776490.749558:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 24 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749566:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 24 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.749575:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776490.749593:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449526144:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776490.749598:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776490.749650:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449525888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.749689:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449526144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.749695:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449526016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776490.750145:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776490.750167:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776490.750177:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13180:x1876716449525760:12345-0@lo:104: 00010000:00010000:0.0:1789776490.750189:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750241:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776490.750247:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13180:x1876716449525760:12345-0@lo:104: Request processed in 73us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776490.750253:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789776490.750272:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776490.750278:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750285:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776490.750288:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750296:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776490.750303:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776490.750316:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789776490.750388:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750394:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776490.750410:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750418:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884a52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.750432:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776490.750433:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776490.750435:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776490.750444:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776490.750474:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884a75 expref: 23 pid: 6510 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.750485:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525376:0@lo:104: 00010000:00010000:0.0:1789776490.750523:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342ce00/0xf13b8042cb884a6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884a67 expref: 22 pid: 6509 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.750532:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525504:0@lo:104: 00010000:00010000:0.0:1789776490.750542:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342d400/0xf13b8042cb884a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884a59 expref: 21 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.750550:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2696300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525632:0@lo:104: 00000100:00100000:0.0:1789776490.750559:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525760:0@lo:104: 00000100:00100000:2.0:1789776490.750643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449526272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776490.750679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776490.750741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776490.751106:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526272 00000100:00100000:0.0:1789776490.751113:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526272 00010000:00010000:0.0:1789776490.751137:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.751168:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789776490.751176:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3645:x1876716449526272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776490.751187:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776490.751192:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.751202:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.751215:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342ca00/0xf13b8042cb884a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884a4b expref: 21 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.751225:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776490.751256:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3645:x1876716449526272:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776490.751262:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776490.751972:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449526272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776490.753863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776490.754138:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672512 00000100:00100000:1.0:1789776490.754147:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672512 00010000:00010000:1.0:1789776490.754182:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 13 pid: 6509 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776490.754218:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:1.0:1789776490.754226:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432672512:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776490.754241:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776490.754247:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 13 pid: 6509 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776490.754262:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 13 pid: 6509 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776490.754286:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776490.754367:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432672512:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 141us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776490.754375:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00010000:00010000:2.0:1789776490.754628:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb884a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56cb expref: 12 pid: 6509 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776490.754656:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525120:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776490.759402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776490.759526:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672640 00000100:00100000:0.0:1789776490.759536:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672640 00010000:00010000:0.0:1789776490.759577:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776490.759616:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1789776490.759626:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:2411:x1876716432672640:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776490.759659:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776490.759665:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759678:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 12 pid: 6511 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759702:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759728:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759745:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759753:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759759:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759767:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759773:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776490.759778:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759787:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759809:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776490.759820:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776490.759871:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:2411:x1876716432672640:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 246us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776490.759880:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00010000:00010000:2.0:1789776490.760255:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb884a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab568c expref: 11 pid: 6511 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776490.760270:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876716449525248:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776490.760303:0:13180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.760314:0:13180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.760321:0:13180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776490.760328:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884abb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776490.915296:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776491.940379:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776492.067275:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776492.067300:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449526400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776492.067415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.067701:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526400 00000100:00100000:3.0:1789776492.067709:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526400 00000100:00100000:2.0:1789776492.067995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776492.068027:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776492.068062:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526528 00000100:00100000:2.0:1789776492.068065:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526528 00000100:00100000:3.0:1789776492.068129:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789776492.068140:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449526400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776492.068171:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776492.068219:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449526400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.068226:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789776492.068300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff438a80 x1876716449526400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776492.068321:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449526400:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789776492.071528:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776492.074243:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789776492.074261:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776492.074291:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776492.074383:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (6354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.074391:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789776492.074470:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff439880 x1876716449526528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776492.074530:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449526528:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789776492.258720:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776492.258727:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc1a65000 from 7 10000000:01000000:3.0:1789776492.258732:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776492.258798:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.258811:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.258823:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776492.258851:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.258925:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.258984:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776492.260757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526656 00000100:00100000:0.0:1789776492.260771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526656 00000100:00100000:0.0:1789776492.260838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789776492.260850:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449526656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776492.260878:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776492.260901:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884ac2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.260930:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.260942:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.260952:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9e00, rc 0) 00000100:00100000:0.0:1789776492.261016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449526656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.261024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789776492.261066:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776492.261084:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.261108:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776492.261183:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.261557:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.261589:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776492.262261:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526784 00000100:00100000:0.0:1789776492.262279:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526784 00000100:00100000:0.0:1789776492.262325:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789776492.262344:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449526784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.263485:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449526784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1147us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.264216:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789776492.265355:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.265426:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.265524:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.265559:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776492.265852:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449526912 00000100:00100000:0.0:1789776492.265871:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449526912 00000100:00100000:0.0:1789776492.265924:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789776492.265933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449526912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.266040:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449526912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.266049:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789776492.266300:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449526912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789776492.267716:0:13230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789776492.267950:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789776492.267975:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776492.267986:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.267999:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776492.268010:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776492.268013:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cfc247800 from 7 10000000:01000000:0.0:1789776492.268016:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776492.268054:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.268063:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.268090:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776492.268129:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.268205:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.268253:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc93516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776492.268578:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527040 00000100:00100000:3.0:1789776492.268596:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527040 00000100:00100000:3.0:1789776492.268639:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789776492.268648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449527040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776492.268662:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776492.268677:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884ad0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.268715:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.268726:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.268748:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257a00, rc 0) 00000100:00100000:3.0:1789776492.268791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.268798:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789776492.269027:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776492.269042:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.269051:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776492.269125:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.269273:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.269304:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc93516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776492.269424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527168 00000100:00100000:3.0:1789776492.269430:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527168 00000100:00100000:3.0:1789776492.269457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789776492.269463:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.269785:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.269793:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789776492.269933:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.269969:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.270019:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.270047:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc93516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776492.270229:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527296 00000100:00100000:3.0:1789776492.270234:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527296 00000100:00100000:3.0:1789776492.270271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789776492.270279:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.270439:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.270446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789776492.270530:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776492.271804:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789776492.272335:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789776492.272360:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776492.272372:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.272384:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776492.272398:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776492.272402:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cd0f5c800 from 7 10000000:01000000:1.0:1789776492.272404:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776492.272446:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.272454:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.272462:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776492.272487:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776492.272574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.272762:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527424 00000100:00100000:3.0:1789776492.272770:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527424 00000100:00100000:0.0:1789776492.272857:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789776492.272867:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449527424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776492.272891:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776492.272905:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884ade expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.272927:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884ade expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.272938:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ade expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.272948:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9600, rc 0) 00000100:00100000:0.0:1789776492.272983:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.272990:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789776492.273452:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776492.273478:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776492.273740:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.273760:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776492.273832:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776492.273869:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.273934:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776492.273976:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527552 00000100:00100000:3.0:1789776492.273981:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527552 00000100:00100000:3.0:1789776492.274050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789776492.274059:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.274252:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.274267:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789776492.274549:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776492.274580:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776492.274632:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.274655:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776492.274669:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527680 00000100:00100000:1.0:1789776492.274673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527680 00000100:00100000:1.0:1789776492.274708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789776492.274715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776492.274800:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.274806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789776492.274857:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776492.276775:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789776492.277062:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789776492.277085:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776492.277218:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.277232:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776492.277245:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776492.277248:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cdb443800 from 7 10000000:01000000:0.0:1789776492.277251:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776492.277293:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.277301:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.277325:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776492.277418:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.277489:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.277715:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776492.277753:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527808 00000100:00100000:1.0:1789776492.277761:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527808 00000100:00100000:1.0:1789776492.277837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789776492.277848:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449527808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776492.277861:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776492.277882:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884aec expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.277906:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884aec expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.277918:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884aec expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776492.277927:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0a00, rc 0) 00000100:00100000:1.0:1789776492.277979:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449527808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.277986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789776492.278066:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776492.278082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.278092:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776492.278177:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.278205:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776492.278446:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776492.278477:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449527936 00000100:00100000:0.0:1789776492.278482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449527936 00000100:00100000:0.0:1789776492.278531:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789776492.278537:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449527936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.278643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449527936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.278650:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789776492.278710:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449527936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.278744:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449528064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.278784:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.278803:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776492.278814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528064 00000100:00100000:0.0:1789776492.278818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528064 00000100:00100000:0.0:1789776492.278834:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789776492.278840:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449528064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.278914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449528064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.278922:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789776492.278964:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449528064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776492.279938:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789776492.280003:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789776492.280050:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776492.280060:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776492.280071:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776492.580376:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776492.580457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776492.580558:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528192 00000100:00100000:0.0:1789776492.580568:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528192 00000100:00100000:0.0:1789776492.580628:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789776492.580639:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449528192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776492.580684:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776492.580736:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449528192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.580744:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789776492.580771:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789776492.580804:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3795180 x1876716449528192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776492.580825:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776492.581187:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776492.581219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581242:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449528832:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449529344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581384:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789776492.581389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581421:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449528960:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581455:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449529472:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.581521:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528320 00000100:00100000:1.0:1789776492.581532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528320 00000100:00100000:1.0:1789776492.581564:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789776492.581570:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449528320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776492.581583:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776492.581614:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449528320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.581620:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789776492.581649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528832 00000100:00100000:1.0:1789776492.581652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528832 00000100:00100000:1.0:1789776492.581688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789776492.581696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449528832:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.581737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789776492.581758:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529344 00000100:00100000:1.0:1789776492.581761:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529344 00000100:00100000:1.0:1789776492.581788:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528448 00000100:00100000:1.0:1789776492.581791:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528448 00000100:00100000:1.0:1789776492.581803:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528960 00000100:00100000:1.0:1789776492.581805:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528960 00000100:00100000:1.0:1789776492.581822:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789776492.581829:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581862:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449529344:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.581868:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789776492.581881:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789776492.581887:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.581909:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449528448:12345-0@lo:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.581921:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789776492.581932:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789776492.581938:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449528960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.582301:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529472 00000100:00100000:0.0:1789776492.582307:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529472 00000100:00100000:0.0:1789776492.582343:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789776492.582359:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449529472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.582461:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449528960:12345-0@lo:400:kworker.0 Request processed in 522us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.582469:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1789776492.582553:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776492.582557:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776492.582560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776492.584191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.584216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449528960:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584280:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449529472:12345-0@lo:400:kworker.0 Request processed in 1921us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.584292:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789776492.584345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449528576:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789776492.584419:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedcec380 x1876716449529472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776492.584434:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449529472:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449529088:0@lo:400:kworker.0 00010000:00080000:1.0:1789776492.584452:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc35e5c00 x1876716449528320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776492.584472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776492.584475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.584510:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449528832:0@lo:400:kworker.0 00010000:00080000:1.0:1789776492.584527:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedcef480 x1876716449529344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776492.584536:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776492.584537:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449529344:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584549:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449528704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584581:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.584584:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529088 00000100:00100000:1.0:1789776492.584589:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529088 00000100:00100000:0.0:1789776492.584605:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449529216:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.584632:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528704 00000100:00100000:1.0:1789776492.584636:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528704 00000100:00100000:0.0:1789776492.584637:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776492.584659:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529216 00000100:00100000:1.0:1789776492.584662:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529216 00000100:00100000:0.0:1789776492.584691:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789776492.584753:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449528576 00000100:00100000:3.0:1789776492.584759:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449528576 00000100:00100000:3.0:1789776492.584789:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789776492.584798:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449528576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776492.584867:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449528576:12345-0@lo:400:kworker.0 Request processed in 70us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.584880:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789776492.584945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449529088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.584982:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449529088:12345-0@lo:400:kworker.0 Request processed in 42us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776492.585012:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789776492.585185:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.585221:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449528704:12345-0@lo:400:kworker.0 Request processed in 40us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.585231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789776492.585250:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449529216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776492.585287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449529216:12345-0@lo:400:kworker.0 Request processed in 48us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.585295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789776492.585350:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789776492.585417:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449528704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.585432:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449529216:0@lo:400:kworker.0 00000100:00100000:0.0:1789776492.585443:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc35e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449528576:0@lo:400:kworker.0 00010000:00080000:0.0:1789776492.585454:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e09500 x1876716449529088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776492.585478:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449529088:0@lo:400:kworker.0 00000100:00100000:1.0:1789776492.585609:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1789776492.585642:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776492.585646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776492.668340:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776492.668378:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672768 00000100:00100000:3.0:1789776492.668389:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672768 00000100:00100000:3.0:1789776492.668456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 323 00000100:00100000:3.0:1789776492.668467:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:6182:x1876716432672768:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776492.668485:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776492.668534:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab56fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.668568:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.668580:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.668589:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257800, rc 0) 00000100:00100000:3.0:1789776492.668643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432672768:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 178us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.668651:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 323 00000100:00100000:1.0:1789776492.680454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776492.680653:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432672896 00000100:00100000:0.0:1789776492.680663:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432672896 00000100:00100000:0.0:1789776492.680729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:0.0:1789776492.680739:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432672896:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.681077:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432672896:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 338us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.681085:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:1.0:1789776492.684605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776492.684709:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673024 00000100:00100000:0.0:1789776492.684719:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673024 00000100:00100000:0.0:1789776492.684764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:0.0:1789776492.684774:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432673024:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.684920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432673024:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.684929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:0.0:1789776492.690026:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776492.690436:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673152 00000100:00100000:3.0:1789776492.690446:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673152 00000100:00100000:3.0:1789776492.690529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 326 00000100:00100000:3.0:1789776492.690539:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432673152:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776492.690556:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776492.690574:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5703 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.690603:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.690614:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776492.690634:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257400, rc 0) 00000100:00100000:3.0:1789776492.690700:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432673152:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 162us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.690708:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 326 00000100:00100000:1.0:1789776492.697662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776492.697771:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673280 00000100:00100000:3.0:1789776492.697781:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673280 00000100:00100000:3.0:1789776492.697836:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:3.0:1789776492.697846:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432673280:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776492.698003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432673280:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.698011:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:1.0:1789776492.703663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776492.704164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673408 00000100:00100000:0.0:1789776492.704174:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673408 00000100:00100000:0.0:1789776492.704221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 328 00000100:00100000:0.0:1789776492.704230:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432673408:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776492.704369:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432673408:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 139us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776492.704377:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 328 00010000:00010000:0.0:1789776492.964767:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776493.250855:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776493.250888:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776493.250920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776493.250943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776493.250967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776493.250993:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673536 00000100:00100000:1.0:1789776493.251004:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673536 00000100:00100000:1.0:1789776493.251057:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 329 00000100:00100000:1.0:1789776493.251068:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432673536:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776493.251141:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432673536:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776493.251148:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 329 00000100:00100000:1.0:1789776493.251198:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673664 00000100:00100000:1.0:1789776493.251202:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673664 00000100:00100000:1.0:1789776493.251231:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673920 00000100:00100000:1.0:1789776493.251244:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673920 00000100:00100000:1.0:1789776493.251262:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432673792 00000100:00100000:1.0:1789776493.251264:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432673792 00000100:00100000:1.0:1789776493.251276:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674048 00000100:00100000:1.0:1789776493.251277:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674048 00000100:00100000:1.0:1789776493.251291:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:1.0:1789776493.251297:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432673664:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776493.251425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:2.0:1789776493.251435:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432673920:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776493.251466:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432673920:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776493.251473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:2.0:1789776493.251489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:2.0:1789776493.251513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432673792:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776493.251539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432673792:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776493.251545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:2.0:1789776493.251558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:2.0:1789776493.251564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432674048:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776493.251584:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432674048:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776493.251590:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:1.0:1789776493.253474:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432673664:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2167us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776493.253486:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00080000:1.0:1789776493.253691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776493.253697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776493.986595:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776494.751255:0:13378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789776495.010794:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776495.651195:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449529600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776495.651328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776495.651473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529600 00000100:00100000:1.0:1789776495.651482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529600 00000100:00100000:1.0:1789776495.651570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789776495.651581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449529600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776495.651629:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776495.651679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449529600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776495.651686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789776495.651859:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449529600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776495.651877:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776495.651884:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449529728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776495.651911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776495.652105:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529728 00000100:00100000:1.0:1789776495.652110:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529728 00000100:00100000:1.0:1789776495.652142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776495.652150:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449529728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776495.652170:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789776495.652235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449529728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776495.652256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789776495.652331:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449529728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789776496.034894:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776497.059975:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776497.186697:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776497.186720:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449529856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776497.186839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776497.188682:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529856 00000100:00100000:0.0:1789776497.188696:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529856 00000100:00100000:0.0:1789776497.188781:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776497.188793:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449529856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776497.188827:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776497.188915:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449529856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776497.188923:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789776497.188993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776497.191480:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776497.191521:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449529984:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789776497.191572:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc2694380 x1876716449529856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776497.191596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776497.191605:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449529856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776497.191829:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449529984 00000100:00100000:0.0:1789776497.191836:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449529984 00000100:00100000:0.0:1789776497.191910:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789776497.191920:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449529984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776497.191943:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776497.191998:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449529984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776497.192006:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789776497.192057:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff34b480 x1876716449529984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776497.192072:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449529984:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789776497.192105:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776497.698945:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776497.698970:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449530112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776497.699046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.699185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530112 00000100:00100000:1.0:1789776497.699194:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530112 00000100:00100000:1.0:1789776497.699307:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789776497.699328:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449530112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776497.699359:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776497.699407:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449530112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776497.699415:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789776497.699842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449530368:0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.699882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.699903:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449530880:0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.699923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.699937:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449531392:0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.699960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.699982:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776497.699987:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449530496:0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.700010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.700027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449531008:0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.700047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776497.700096:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531392 00000100:00100000:1.0:1789776497.700100:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531392 00000100:00100000:1.0:1789776497.700148:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789776497.700156:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.700196:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449531392:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776497.700202:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789776497.700227:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530368 00000100:00100000:1.0:1789776497.700231:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530368 00000100:00100000:1.0:1789776497.700255:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530880 00000100:00100000:1.0:1789776497.700258:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530880 00000100:00100000:1.0:1789776497.700271:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531008 00000100:00100000:1.0:1789776497.700274:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531008 00000100:00100000:1.0:1789776497.700287:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789776497.700293:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.700439:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789776497.700449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449530880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.701154:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789776497.701166:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1789776497.701183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776497.701188:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776497.701191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776497.701208:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449530240:0@lo:400:kworker.0 00000100:00100000:0.0:1789776497.701303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449530624:0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.704402:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449530880:12345-0@lo:400:kworker.0 Request processed in 3950us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.704416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789776497.704466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789776497.704771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776497.704817:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449531136:0@lo:400:kworker.0 00000100:00100000:0.0:1789776497.704859:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776497.704902:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530496 00000100:00100000:0.0:1789776497.704910:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530496 00000100:00100000:2.0:1789776497.705010:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776497.705124:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449531008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.705178:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449531008:12345-0@lo:400:kworker.0 Request processed in 704us (5130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.705186:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789776497.705293:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449530752:0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.705390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776497.705413:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449531264:0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.705436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789776497.705466:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0ad80 x1876716449530112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776497.705767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530624 00000100:00100000:3.0:1789776497.705785:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530624 00000100:00100000:1.0:1789776497.705790:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449530368:12345-0@lo:400:kworker.0 Request processed in 5495us (5906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776497.705798:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789776497.705810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531136 00000100:00100000:3.0:1789776497.705813:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531136 00000100:00100000:1.0:1789776497.705814:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531264 00000100:00100000:1.0:1789776497.705816:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531264 00000100:00100000:2.0:1789776497.705865:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449530112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776497.705901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530752 00000100:00100000:2.0:1789776497.705904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530752 00000100:00100000:0.0:1789776497.706018:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789776497.706026:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449530496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776497.706137:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449530496:12345-0@lo:400:kworker.0 Request processed in 112us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776497.706143:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789776497.706376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789776497.706384:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.706423:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449530624:12345-0@lo:400:kworker.0 Request processed in 41us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.706429:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789776497.706442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789776497.706447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449531136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.706470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449531136:12345-0@lo:400:kworker.0 Request processed in 23us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.706475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789776497.706876:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789776497.706886:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.706998:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449530752:12345-0@lo:400:kworker.0 Request processed in 114us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776497.707014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789776497.707413:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449530240 00000100:00100000:3.0:1789776497.707418:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449530240 00000100:00100000:3.0:1789776497.707447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789776497.707454:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449530240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.707801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449530752:0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.707849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449531520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776497.707890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776497.708129:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449530496:0@lo:400:kworker.0 00010000:00080000:0.0:1789776497.708155:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3c1c000 x1876716449531008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776497.708166:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449531008:0@lo:400:kworker.0 00000100:00100000:0.0:1789776497.708179:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449530368:0@lo:400:kworker.0 00000100:00100000:0.0:1789776497.708192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449530880:0@lo:400:kworker.0 00010000:00080000:0.0:1789776497.708202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3c1d500 x1876716449531392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776497.708210:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449531392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.708304:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449530240:12345-0@lo:400:kworker.0 Request processed in 586us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.708379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789776497.708444:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531520 00000100:00100000:2.0:1789776497.708448:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531520 00000100:00100000:1.0:1789776497.708801:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789776497.708811:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449531264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776497.708864:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449531264:12345-0@lo:400:kworker.0 Request processed in 53us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776497.708871:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789776497.709001:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449530240:0@lo:400:kworker.0 00000100:00080000:3.0:1789776497.709133:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776497.709139:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776497.709196:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3c1ea00 x1876716449531264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776497.709220:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789776497.709242:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449531520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776497.709261:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776497.709318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449531264:0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.709963:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449530624:0@lo:400:kworker.0 00000100:00100000:3.0:1789776497.709980:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449531136:0@lo:400:kworker.0 00000100:00100000:2.0:1789776497.710235:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449531520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 998us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776497.710243:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789776497.710402:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc81f4e00 x1876716449531520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776497.710419:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc81f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449531520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789776498.090596:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776498.373317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776498.373348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776498.373378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776498.373399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776498.373443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776498.373476:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674432 00000100:00100000:0.0:1789776498.373485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674432 00000100:00100000:0.0:1789776498.373580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674688 00000100:00100000:0.0:1789776498.373584:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674688 00000100:00100000:0.0:1789776498.373601:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674304 00000100:00100000:0.0:1789776498.373604:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674304 00000100:00100000:0.0:1789776498.373618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674560 00000100:00100000:0.0:1789776498.373620:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674560 00000100:00100000:0.0:1789776498.373638:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:0.0:1789776498.373648:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432674432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776498.373723:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432674432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776498.373731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:0.0:1789776498.373750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:0.0:1789776498.373757:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432674688:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776498.373783:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432674688:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776498.373815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:0.0:1789776498.373829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1789776498.373835:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432674304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776498.373864:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432674304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776498.373870:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1789776498.373883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1789776498.373889:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432674560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776498.373914:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432674560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776498.373921:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00080000:0.0:1789776498.373945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776498.373948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776498.374120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674176 00000100:00100000:1.0:1789776498.374126:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674176 00000100:00100000:1.0:1789776498.374164:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 331 00000100:00100000:1.0:1789776498.374178:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432674176:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776498.374211:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432674176:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776498.374217:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 331 00010000:00010000:0.0:1789776499.106939:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776500.130678:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776500.373937:0:13528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:08:20 (1789776500) === 00000100:00100000:0.0:1789776500.554568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.554774:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776500.554867:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674944 00000100:00100000:1.0:1789776500.554890:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674944 00000100:00100000:2.0:1789776500.554924:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432674816 00000100:00100000:2.0:1789776500.554935:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432674816 00000100:00100000:1.0:1789776500.554973:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1789776500.554986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:10501:x1876716432674944:12345-192.168.204.27@tcp:700:mkdir.0 00000100:00080000:0.0:1789776500.555034:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776500.555095:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:10501:x1876716432674944:12345-192.168.204.27@tcp:700:mkdir.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776500.555104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1789776500.555397:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776500.555409:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432674816:12345-192.168.204.27@tcp:41:mkdir.0 00000004:00000024:2.0:1789776500.555454:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776500.555666:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432674816:12345-192.168.204.27@tcp:41:mkdir.0 Request processed in 259us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.555674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1789776500.559588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.559653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675200 00000100:00100000:0.0:1789776500.559671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675200 00000100:00100000:0.0:1789776500.559774:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1789776500.559788:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:10501:x1876716432675200:12345-192.168.204.27@tcp:36:mkdir.0 00010000:00010000:0.0:1789776500.559868:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776500.560573:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8849aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5677 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560632:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc33d3f00) 00010000:00010000:0.0:1789776500.560645:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776500.560781:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560796:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560806:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560834:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560843:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.560849:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.561966:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562055:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562065:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776500.562083:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fbfe9ba reply state 000000005dc43e8e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562106:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562913:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776500.562916:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776500.562920:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789776500.562927:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789776500.562937:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562943:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562950:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562955:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.562959:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.562967:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.563048:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cf512d100) 00010000:00010000:0.0:1789776500.563052:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776500.563055:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.563062:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776500.563096:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fbfe9ba reply state 000000005dc43e8e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.563315:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.563325:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5cf512d800) 00010000:00010000:0.0:1789776500.563328:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776500.563331:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789776500.563792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10501:x1876716432675200:12345-192.168.204.27@tcp:36:mkdir.0 Request processed in 3773us (3980us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789776500.563806:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1789776500.581100:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776500.586241:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675328 00000100:00100000:2.0:1789776500.586256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675328 00000100:00100000:2.0:1789776500.586334:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776500.586345:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10502:x1876716432675328:12345-192.168.204.27@tcp:101:chmod.0 00010000:00010000:2.0:1789776500.586368:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776500.586411:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab570a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586490:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586560:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776500.586609:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776500.586613:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776500.586650:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586677:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab570a expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586695:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab570a expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.586704:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121900) 00010000:00010000:2.0:1789776500.586708:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776500.586712:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2e00, rc 0) 00000100:00100000:2.0:1789776500.586773:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:10502:x1876716432675328:12345-192.168.204.27@tcp:101:chmod.0 Request processed in 429us (5681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.586780:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1789776500.590605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776500.590800:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675584 00000100:00100000:1.0:1789776500.590816:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675584 00000100:00100000:1.0:1789776500.590945:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1789776500.590957:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:10502:x1876716432675584:12345-192.168.204.27@tcp:36:chmod.0 00010000:00010000:1.0:1789776500.591016:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776500.591048:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2e00/0xf13b8042cb884b24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab570a expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.591084:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121900) 00010000:00010000:1.0:1789776500.591095:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776500.591122:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.591155:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.591166:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776500.591383:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dfb7a1e reply state 00000000b20add31 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.591395:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.591402:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:1.0:1789776500.591404:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789776500.591407:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789776500.591414:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789776500.591804:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:10502:x1876716432675584:12345-192.168.204.27@tcp:36:chmod.0 Request processed in 847us (1213us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789776500.591813:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1789776500.630115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.630233:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675712 00000100:00100000:0.0:1789776500.630243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675712 00000100:00100000:0.0:1789776500.630311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1789776500.630322:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:10503:x1876716432675712:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:0.0:1789776500.630347:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776500.630379:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5711 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.630447:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.630462:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.630473:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776500.631014:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776500.631024:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776500.631064:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.631094:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5711 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.631115:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5711 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.631125:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:2.0:1789776500.631128:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776500.631131:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9800, rc 0) 00000100:00100000:2.0:1789776500.631198:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:10503:x1876716432675712:12345-192.168.204.27@tcp:101:chown.0 Request processed in 877us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.631205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1789776500.634630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.634935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675840 00000100:00100000:3.0:1789776500.634959:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675840 00000100:00100000:3.0:1789776500.635011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1789776500.635022:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:10503:x1876716432675840:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:3.0:1789776500.635055:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776500.635078:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5718 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635150:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635177:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635188:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635201:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635282:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635291:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635298:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776500.635347:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776500.635350:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776500.635385:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635399:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635406:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635413:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635419:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.635423:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635431:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635444:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:3.0:1789776500.635447:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776500.635452:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635471:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635489:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635555:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635559:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.635563:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635569:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635577:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5cf512d800) 00010000:00010000:3.0:1789776500.635580:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776500.635583:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635589:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635616:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5718 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635630:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5718 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.635637:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776500.635639:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776500.635648:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256600, rc 0) 00000100:00100000:3.0:1789776500.635732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10503:x1876716432675840:12345-192.168.204.27@tcp:101:chown.0 Request processed in 711us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.635740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1789776500.642931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.643044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432675968 00000100:00100000:0.0:1789776500.643055:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432675968 00000100:00100000:0.0:1789776500.643119:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1789776500.643131:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10503:x1876716432675968:12345-192.168.204.27@tcp:900:chown.0 00000100:00100000:0.0:1789776500.643228:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10503:x1876716432675968:12345-192.168.204.27@tcp:900:chown.0 Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776500.643236:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1789776500.653640:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.653822:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432676224 00000100:00100000:0.0:1789776500.653838:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432676224 00000100:00100000:0.0:1789776500.653972:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1789776500.653985:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10503:x1876716432676224:12345-192.168.204.27@tcp:36:chown.0 00010000:00010000:0.0:1789776500.654063:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776500.654097:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884b55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5718 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.654119:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776500.654125:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776500.654154:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.654170:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.654181:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776500.665642:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1789776500.665844:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665884:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665892:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665898:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.665903:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665912:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665928:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5cf512d800) 00010000:00010000:0.0:1789776500.665932:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776500.665937:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665944:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665964:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665972:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665978:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665983:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.665992:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.665999:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666008:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776500.666010:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776500.666013:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666019:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666032:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666038:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666044:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666049:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.666052:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666058:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666064:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:0.0:1789776500.666066:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776500.666073:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.666079:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884b2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776500.666201:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1863828 reply state 00000000463f3362 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.666218:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.666225:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776500.666228:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789776500.666231:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789776500.666251:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789776500.666350:0:13443:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789776500.668471:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10503:x1876716432676224:12345-192.168.204.27@tcp:36:chown.0 Request processed in 14476us (14837us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789776500.668512:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00010000:00010000:0.0:1789776500.673022:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673040:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673049:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673056:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.673060:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673068:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673085:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776500.673089:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776500.673094:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.673100:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776500.693759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.693920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432676352 00000100:00100000:0.0:1789776500.693932:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432676352 00000100:00100000:0.0:1789776500.694002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1789776500.694026:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:10504:x1876716432676352:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1789776500.694049:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776500.694070:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab571f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789776500.698222:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4100us 00010000:00010000:2.0:1789776500.714204:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714228:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714241:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714262:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714270:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714277:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714413:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714422:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714430:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776500.714461:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776500.714464:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776500.714567:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714580:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714587:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714595:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714601:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776500.714606:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714613:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714625:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:2.0:1789776500.714628:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776500.714632:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714638:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884b6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714649:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714656:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714663:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714674:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776500.714678:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714694:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714703:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776500.714705:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776500.714709:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714715:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884b71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714755:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab571f expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714771:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab571f expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.714779:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:2.0:1789776500.714782:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789776500.714784:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776500.714848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10504:x1876716432676352:12345-192.168.204.27@tcp:101:touch.500 Request processed in 20824us (21099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.714857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1789776500.723437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.723824:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432676608 00000100:00100000:0.0:1789776500.723836:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432676608 00000100:00100000:0.0:1789776500.723900:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776500.723913:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10504:x1876716432676608:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1789776500.723935:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776500.723957:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5726 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724067:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724084:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724097:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724155:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724164:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.724187:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789776500.724581:0:10345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789776500.724742:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884b94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728740:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728756:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728823:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728832:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728839:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728845:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.728849:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728856:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728869:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:0.0:1789776500.728872:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776500.728894:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728900:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884b86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776500.728917:0:10345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b30feb06 reply state 00000000c3a61b7d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728929:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.728936:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776500.728938:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776500.728942:0:10345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789776500.728985:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8e00/0xf13b8042cb884b7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5726 expref: 10 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.729001:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5726 expref: 9 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.729009:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5cf512d800) 00010000:00010000:0.0:1789776500.729011:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776500.729014:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9a00, rc 0) 00000100:00100000:0.0:1789776500.729084:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:10504:x1876716432676608:12345-192.168.204.27@tcp:101:touch.500 Request processed in 5173us (5657us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789776500.729093:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:1.0:1789776500.740460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776500.745149:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432676864 00000100:00100000:2.0:1789776500.745182:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432676864 00000100:00100000:2.0:1789776500.745362:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1789776500.745373:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:10504:x1876716432676864:12345-192.168.204.27@tcp:36:touch.500 00010000:00010000:2.0:1789776500.745593:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776500.745622:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884b94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5726 expref: 10 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.745641:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5cf512d800) 00010000:00010000:2.0:1789776500.745650:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776500.745703:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.745717:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.745727:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776500.745950:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bca3e77e reply state 000000004d2af50f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.745963:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.745970:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776500.745973:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776500.745975:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776500.746118:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10504:x1876716432676864:12345-192.168.204.27@tcp:36:touch.500 Request processed in 745us (5665us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789776500.746126:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1789776500.748416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.748672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432676992 00000100:00100000:0.0:1789776500.748683:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432676992 00000100:00100000:3.0:1789776500.749220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1789776500.749232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:10504:x1876716432676992:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:3.0:1789776500.749258:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776500.749279:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884ba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab572d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.749337:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab572d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.749351:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab572d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.749368:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776500.749371:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776500.749375:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256e00, rc 0) 00000100:00100000:3.0:1789776500.749437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:10504:x1876716432676992:12345-192.168.204.27@tcp:101:touch.500 Request processed in 207us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.749443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1789776500.754205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776500.754352:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432677120 00000100:00100000:2.0:1789776500.754363:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432677120 00000100:00100000:2.0:1789776500.754414:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776500.754422:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1876716432677120:12345-192.168.204.27@tcp:8:touch.500 00010000:00080000:2.0:1789776500.754457:0:8528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1789776500.754682:0:8528:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb884bb0 00002000:00100000:3.0:1789776500.754815:0:8528:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1c6b552f-1300-40e3-a848-4343cb28ffe2/ffff8a5bc3c80000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776500.754848:0:8528:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789776500.755061:0:8528:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789776500.755093:0:8528:0:(import.c:65:import_set_state_nolock()) ffff8a5bc37d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776500.755163:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432677120:12345-192.168.204.27@tcp:8:touch.500 Request processed in 740us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.755173:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1789776500.758337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776500.758459:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432677248 00000100:00100000:2.0:1789776500.758469:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432677248 00000100:00100000:2.0:1789776500.758596:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1789776500.758606:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432677248:12345-192.168.204.27@tcp:2:touch.500 00000100:00080000:0.0:1789776500.759276:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776500.770620:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776500.770650:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449531648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776500.770738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776500.770803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531648 00000100:00100000:0.0:1789776500.770810:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531648 00000100:00100000:0.0:1789776500.770854:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789776500.770863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449531648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776500.770897:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1789776500.770939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449531648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776500.770958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789776500.771003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449531648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776500.771225:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776500.771235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449531776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776500.771267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776500.771449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531776 00000100:00100000:0.0:1789776500.771454:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531776 00000100:00100000:0.0:1789776500.771525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789776500.771533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449531776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776500.771551:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776500.771587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449531776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776500.771593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789776500.771721:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449531776:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1789776500.774258:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789776500.774283:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000100:00100000:3.0:1789776500.774738:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:0:x1876716432677248:12345-192.168.204.27@tcp:2:touch.500 Request processed in 16118us (16395us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789776500.774750:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1789776500.777780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.777912:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432677504 00000100:00100000:3.0:1789776500.777921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432677504 00000100:00100000:3.0:1789776500.777981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1789776500.777991:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:10504:x1876716432677504:12345-192.168.204.27@tcp:35:touch.500 00000100:00100000:3.0:1789776500.778403:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+13:10504:x1876716432677504:12345-192.168.204.27@tcp:35:touch.500 Request processed in 412us (631us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789776500.778412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1789776500.806631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.806724:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432677632 00000100:00100000:0.0:1789776500.806739:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432677632 00000100:00100000:0.0:1789776500.806836:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1789776500.806847:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+13:10505:x1876716432677632:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:0.0:1789776500.806869:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776500.806907:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5734 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807007:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807021:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807036:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776500.807081:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789776500.807084:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776500.807125:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807152:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5734 expref: 15 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807176:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5734 expref: 14 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.807184:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:0.0:1789776500.807199:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776500.807203:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9000, rc 0) 00000100:00100000:0.0:1789776500.807287:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:10505:x1876716432677632:12345-192.168.204.27@tcp:101:rm.0 Request processed in 441us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776500.807294:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1789776500.813605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776500.813703:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432677888 00000100:00100000:2.0:1789776500.813712:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432677888 00000100:00100000:2.0:1789776500.813766:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1789776500.813775:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:10505:x1876716432677888:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:2.0:1789776500.813796:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776500.813816:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab573b expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776500.813930:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789776500.814396:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884bc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab573b expref: 16 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.814411:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:2.0:1789776500.814414:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776500.814433:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab573b expref: 16 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776500.814447:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2c00, rc 0) 00000100:00100000:2.0:1789776500.814570:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:10505:x1876716432677888:12345-192.168.204.27@tcp:101:rm.0 Request processed in 794us (974us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789776500.814579:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1789776500.820334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776500.821902:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432678016 00000100:00100000:1.0:1789776500.821917:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432678016 00000100:00100000:1.0:1789776500.821992:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1789776500.822018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:10505:x1876716432678016:12345-192.168.204.27@tcp:37:rm.0 00000100:00100000:3.0:1789776500.835043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:10505:x1876716432678016:12345-192.168.204.27@tcp:37:rm.0 Request processed in 13017us (14708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.835058:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1789776500.839581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.839710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432678272 00000100:00100000:3.0:1789776500.839719:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432678272 00000100:00100000:1.0:1789776500.839835:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1789776500.839848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:10505:x1876716432678272:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:1.0:1789776500.840115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:10505:x1876716432678272:12345-192.168.204.27@tcp:35:rm.0 Request processed in 270us (543us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789776500.840123:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1789776500.844791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.844949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432678528 00000100:00100000:3.0:1789776500.844959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432678528 00000100:00100000:3.0:1789776500.845062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:3.0:1789776500.845072:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:10505:x1876716432678528:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:3.0:1789776500.845096:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776500.845116:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5742 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.845216:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884bda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.845231:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884bda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.845242:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884bda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776500.845253:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789776500.845357:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5742 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.845377:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884bda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5742 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.845385:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:3.0:1789776500.845388:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776500.845390:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256a00, rc 0) 00000100:00100000:3.0:1789776500.845461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432678528:12345-192.168.204.27@tcp:101:rm.0 Request processed in 390us (680us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789776500.845468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1789776500.852360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.854101:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432678656 00000100:00100000:0.0:1789776500.854115:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432678656 00000100:00100000:0.0:1789776500.854199:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1789776500.854211:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432678656:12345-192.168.204.27@tcp:41:rm.0 00000004:00000024:0.0:1789776500.854280:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789776500.854374:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432678656:12345-192.168.204.27@tcp:41:rm.0 Request processed in 166us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776500.854383:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1789776500.856729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.856811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432678784 00000100:00100000:3.0:1789776500.856820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432678784 00000100:00100000:3.0:1789776500.856874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1789776500.856884:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432678784:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:3.0:1789776500.856903:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776500.856923:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884be8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5749 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857179:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857195:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857207:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857219:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857227:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857233:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857374:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.857383:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859096:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776500.859164:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789776500.859169:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776500.859190:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859206:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859216:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859224:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859232:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859238:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.859242:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859251:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859264:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:3.0:1789776500.859267:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776500.859272:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859297:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859315:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859322:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859328:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859333:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.859337:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859343:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859352:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776500.859354:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776500.859357:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859363:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859739:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884be8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5749 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859761:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5749 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.859776:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776500.859778:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776500.859781:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257000, rc 0) 00000100:00100000:2.0:1789776500.861920:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:10505:x1876716432678784:12345-192.168.204.27@tcp:101:rm.0 Request processed in 5026us (5187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.861932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1789776500.868353:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.868430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679040 00000100:00100000:3.0:1789776500.868440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679040 00000100:00100000:3.0:1789776500.868519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1789776500.868531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:10505:x1876716432679040:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:3.0:1789776500.868584:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789776500.868613:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257000/0xf13b8042cb884bfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5749 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868633:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb884ba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab572d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868644:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776500.868656:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5734 expref: 17 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868664:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:3.0:1789776500.868667:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776500.868688:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868701:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868711:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868733:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868740:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868747:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868833:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868841:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.868847:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776500.869142:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789776500.869153:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322113659959ns, next at 323113657535ns, rc = 0 00010000:00010000:3.0:1789776500.869199:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869208:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869215:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869222:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869238:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869244:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869261:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776500.869279:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869285:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869290:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869296:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.869300:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869306:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869314:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776500.869316:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789776500.869320:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869325:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256600/0xf13b8042cb884c12 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869339:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869351:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869357:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869363:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776500.869366:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869371:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869378:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:3.0:1789776500.869380:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776500.869383:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869388:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256400/0xf13b8042cb884c04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776500.869397:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a599ddd reply state 00000000f7e4e943 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869407:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776500.869413:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776500.869415:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789776500.869418:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789776500.869533:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776500.869540:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.869657:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776500.869661:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.869668:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.869677:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776500.869679:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789776500.869682:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.869687:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884c19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776500.869697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776500.869700:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776500.869701:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776500.871257:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432679040:12345-192.168.204.27@tcp:36:rm.0 Request processed in 2602us (2786us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789776500.871283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1789776500.881558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776500.881627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679296 00000100:00100000:3.0:1789776500.881637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679296 00000100:00100000:3.0:1789776500.881698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1789776500.881709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432679296:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:3.0:1789776500.881936:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:10505:x1876716432679296:12345-192.168.204.27@tcp:35:rm.0 Request processed in 228us (387us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789776500.881954:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1789776500.888657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776500.888779:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679552 00000100:00100000:0.0:1789776500.888791:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679552 00000100:00100000:0.0:1789776500.888862:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1789776500.888874:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:10505:x1876716432679552:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:0.0:1789776500.888950:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789776500.888980:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb884bda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5742 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889006:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab571f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889031:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5bc1a87900) 00010000:00010000:0.0:1789776500.889048:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9800/0xf13b8042cb884b39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5711 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889056:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3ede900) 00010000:00010000:0.0:1789776500.889074:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776500.889099:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889124:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889146:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889163:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889172:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889180:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889260:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889268:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889276:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776500.889553:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789776500.889567:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889576:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889582:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889596:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.889600:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889608:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889617:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a5cf512de00) 00010000:00010000:0.0:1789776500.889619:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789776500.889623:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889628:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8a00/0xf13b8042cb884c2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889646:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889652:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889658:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889663:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776500.889666:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889672:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889693:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cf512d100) 00010000:00010000:0.0:1789776500.889695:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776500.889699:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889704:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb884c20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776500.889716:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000549ec236 reply state 000000001751dd1a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889726:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776500.889732:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5cf512d700) 00010000:00010000:0.0:1789776500.889734:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776500.889737:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776500.889815:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:10505:x1876716432679552:12345-192.168.204.27@tcp:36:rm.0 Request processed in 942us (1172us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789776500.889824:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00010000:00010000:0.0:1789776501.154806:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776502.182936:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789776502.306941:0:8524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323551442303ns, next at 324551439226ns, rc = 0 00000100:00100000:0.0:1789776502.307391:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449531904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776502.307471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.307587:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776502.307593:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449532032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776502.307620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776502.307704:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449531904 00000100:00100000:1.0:1789776502.307713:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449531904 00000100:00100000:1.0:1789776502.307768:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532032 00000100:00100000:1.0:1789776502.307772:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532032 00000100:00100000:1.0:1789776502.307793:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789776502.307802:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449531904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776502.307845:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776502.307889:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449531904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776502.307895:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789776502.307921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776502.307926:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449532032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776502.307934:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776502.307952:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449532032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776502.307957:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789776502.308103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776502.308129:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35dc00 x1876716449532032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776502.308164:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449532032:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789776502.308178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3708e00 x1876716449531904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776502.308190:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449531904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776502.818920:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776502.818950:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449532160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776502.819046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.821929:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449532672:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.821996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822057:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449533184:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822106:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533696:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789776502.822163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449532288:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822211:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449532800:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776502.822303:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533184 00000100:00100000:3.0:1789776502.822311:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533184 00000100:00100000:3.0:1789776502.822351:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533696 00000100:00100000:3.0:1789776502.822368:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533696 00000100:00100000:3.0:1789776502.822486:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533312 00000100:00100000:3.0:1789776502.822490:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533312 00000100:00100000:3.0:1789776502.822531:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776502.822539:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449533184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.822590:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449533184:12345-0@lo:400:kworker.0 Request processed in 51us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776502.822598:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776502.822615:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789776502.822621:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.822764:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532160 00000100:00100000:0.0:1789776502.822769:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532160 00000100:00100000:0.0:1789776502.822800:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789776502.822808:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449532160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776502.822830:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776502.822867:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449532160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.822875:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789776502.822901:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449532416:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.822932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.822954:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449532928:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.822974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.822993:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449533440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.823033:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789776502.823039:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449532544:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.823077:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449533056:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.823131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449533568:0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776502.823182:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789776502.823191:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823224:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533312:12345-0@lo:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.823231:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789776502.823251:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532800 00000100:00100000:0.0:1789776502.823255:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532800 00000100:00100000:0.0:1789776502.823279:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532544 00000100:00100000:0.0:1789776502.823282:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532544 00000100:00100000:0.0:1789776502.823296:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789776502.823303:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.823337:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449532800:12345-0@lo:400:kworker.0 Request processed in 34us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.823343:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789776502.823356:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789776502.823362:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449532544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.823600:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533696:12345-0@lo:400:kworker.0 Request processed in 978us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776502.823606:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789776502.823627:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532288 00000100:00100000:3.0:1789776502.823630:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532288 00000100:00100000:0.0:1789776502.823883:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449532544:12345-0@lo:400:kworker.0 Request processed in 520us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.823889:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789776502.823908:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776502.823925:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532672 00000100:00100000:0.0:1789776502.823929:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532672 00000100:00100000:0.0:1789776502.823951:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532416 00000100:00100000:0.0:1789776502.823954:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532416 00000100:00100000:0.0:1789776502.823965:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449532928 00000100:00100000:0.0:1789776502.823968:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449532928 00000100:00100000:0.0:1789776502.823997:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533440 00000100:00100000:0.0:1789776502.824000:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533440 00000100:00100000:0.0:1789776502.824011:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533056 00000100:00100000:0.0:1789776502.824014:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533056 00000100:00100000:0.0:1789776502.824028:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533568 00000100:00100000:0.0:1789776502.824031:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533568 00000100:00100000:0.0:1789776502.824048:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789776502.824054:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824095:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449532672:12345-0@lo:400:kworker.0 Request processed in 41us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824101:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789776502.824113:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789776502.824119:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449532416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824150:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449532416:12345-0@lo:400:kworker.0 Request processed in 32us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824157:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789776502.824171:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789776502.824177:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824203:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449532928:12345-0@lo:400:kworker.0 Request processed in 27us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824209:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789776502.824221:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789776502.824226:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824252:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449533440:12345-0@lo:400:kworker.0 Request processed in 27us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824258:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789776502.824270:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776502.824284:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824311:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449533056:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824317:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776502.824328:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789776502.824334:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776502.824361:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449533568:12345-0@lo:400:kworker.0 Request processed in 29us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.824367:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789776502.824530:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789776502.824540:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449532288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.824574:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449532288:12345-0@lo:400:kworker.0 Request processed in 37us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776502.824580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00080000:3.0:1789776502.824892:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35dc00 x1876716449532160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776502.824915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449532160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776502.824956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449532288:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.824970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449532800:0@lo:400:kworker.0 00010000:00080000:3.0:1789776502.824998:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f4e00 x1876716449533312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776502.825008:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776502.825021:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449532672:0@lo:400:kworker.0 00010000:00080000:3.0:1789776502.825033:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f7480 x1876716449533184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776502.825041:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449533184:0@lo:400:kworker.0 00010000:00080000:3.0:1789776502.825054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815c000 x1876716449533696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776502.825062:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533696:0@lo:400:kworker.0 00000100:00080000:2.0:1789776502.826520:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776502.826528:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776502.826580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449532544:0@lo:400:kworker.0 00010000:00080000:2.0:1789776502.826599:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f7100 x1876716449533056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776502.826611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449533056:0@lo:400:kworker.0 00010000:00080000:2.0:1789776502.826624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815ce00 x1876716449533568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776502.826634:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449533568:0@lo:400:kworker.0 00000100:00100000:2.0:1789776502.826646:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449532416:0@lo:400:kworker.0 00000100:00100000:2.0:1789776502.826673:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449532928:0@lo:400:kworker.0 00000100:00100000:2.0:1789776502.826684:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449533440:0@lo:400:kworker.0 00000100:00100000:1.0:1789776502.830982:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776502.831005:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776502.831097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776502.831155:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533824 00000100:00100000:1.0:1789776502.831163:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533824 00000100:00100000:1.0:1789776502.831214:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776502.831224:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776502.831268:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776502.831316:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449533824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776502.831324:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789776502.833745:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cc815d500 x1876716449533824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776502.833791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449533824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776503.206715:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776503.485045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485168:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776503.485266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679936 00000100:00100000:0.0:1789776503.485266:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679680 00000100:00100000:1.0:1789776503.485276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679936 00000100:00100000:0.0:1789776503.485276:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679680 00000100:00100000:1.0:1789776503.485316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680192 00000100:00100000:1.0:1789776503.485319:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680192 00000100:00100000:0.0:1789776503.485320:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 333 00000100:00100000:0.0:1789776503.485329:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432679680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776503.485331:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432679808 00000100:00100000:1.0:1789776503.485333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432679808 00000100:00100000:1.0:1789776503.485343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680320 00000100:00100000:1.0:1789776503.485345:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680320 00000100:00100000:1.0:1789776503.485357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:1.0:1789776503.485362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432679936:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776503.485395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432679936:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.485401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:1.0:1789776503.485431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:1.0:1789776503.485586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432680192:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776503.495423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432680192:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 9829us (10276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.495423:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432679680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 10084us (10376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.495437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 333 00000100:00100000:2.0:1789776503.495456:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:2.0:1789776503.495490:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2414:x1876716432679808:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776503.496573:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:0.0:1789776503.496586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432680320:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776503.496669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2414:x1876716432680320:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (11432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.496677:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:0.0:1789776503.496883:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680064 00000100:00100000:0.0:1789776503.496892:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680064 00000100:00100000:0.0:1789776503.496941:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1789776503.496949:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432680064:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776503.497001:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432680064:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 52us (11802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.497009:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00080000:0.0:1789776503.497151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776503.497157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776503.497160:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776503.497561:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2414:x1876716432679808:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2084us (12390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776503.497569:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:1.0:1789776503.502099:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00010000:00010000:0.0:1789776504.227629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776504.655463:0:13676:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789776505.252039:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789776505.783202:0:13724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4fec2bb0 20000000:00000080:3.0:1789776505.783223:0:13724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cff3f0c00 uarg=0000000000000000 20000000:01000000:3.0:1789776505.783272:0:13724:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789776505.783279:0:13724:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789776505.783285:0:13724:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789776505.784768:0:13725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789776505.785043:0:13724:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789776505.792987:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000004:00080000:3.0:1789776505.795621:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789776505.795663:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789776505.795676:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789776505.795756:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795770:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795778:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795784:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776505.795789:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795797:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795817:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776505.795821:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776505.795826:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795833:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb884b8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795868:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795875:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795880:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795885:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776505.795888:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795894:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795902:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:0.0:1789776505.795904:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776505.795907:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795912:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2800/0xf13b8042cb884ba2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795929:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795936:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795942:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795953:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776505.795956:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795962:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795970:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776505.795973:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776505.795975:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795981:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb884c0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.795996:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796002:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796008:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796013:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776505.796015:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796021:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796043:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a5cf512d700) 00010000:00010000:0.0:1789776505.796045:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776505.796048:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.796053:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884c27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776505.796436:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776505.796456:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449533952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789776505.796546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776505.796728:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449533952 00000100:00100000:3.0:1789776505.796736:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449533952 00000100:00100000:3.0:1789776505.796801:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776505.796810:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449533952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789776505.796845:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789776505.796878:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aadd275, atime: 0x6aadd275, ctime: 0x6aadd275, blocks: 0x0 00010000:00010000:3.0:1789776505.796886:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.796901:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1789776505.796905:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776505.796912:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.796928:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.796936:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.796944:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.796959:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776505.797431:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776505.797439:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.797447:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776505.797450:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.797458:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.797475:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.797482:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8051d46/0xf13b8042cb884c35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.797523:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776505.797525:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776505.797535:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776505.797767:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449533952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (561us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789776505.797777:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789776505.797847:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789776505.797894:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cc815d880/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789776505.797900:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449533952:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1789776505.798170:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789776505.798212:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789776505.798237:0:13724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776505.798254:0:13724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798268:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798276:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798282:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884ade expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798290:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884aec expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798299:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798306:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798313:0:13724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798348:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798361:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 12 pid: 6509 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.798386:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534080:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776505.798820:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798829:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 12 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.798839:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534208:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776505.798877:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.798886:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 23 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.798895:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534336:0@lo:104: 00000100:00100000:0.0:1789776505.798934:0:13724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776505.799010:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.799018:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 23 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.799026:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534464:0@lo:104: 00010000:00010000:0.0:1789776505.799050:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.799058:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 23 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.799077:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534592:0@lo:104: 00010000:00010000:0.0:1789776505.799105:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.799123:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 23 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.799131:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534720:0@lo:104: 00000100:00100000:0.0:1789776505.799150:0:13724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776505.800018:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789776505.800043:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776505.800101:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776505.800198:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.800223:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534336 00000100:00100000:1.0:1789776505.800232:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534336 00000100:00100000:1.0:1789776505.800271:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534464 00000100:00100000:1.0:1789776505.800274:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534464 00000100:00100000:1.0:1789776505.800283:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534592 00000100:00100000:1.0:1789776505.800286:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534592 00000100:00100000:1.0:1789776505.800298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789776505.800306:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:13724:x1876716449534336:12345-0@lo:104: 00010000:00010000:1.0:1789776505.800321:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800399:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776505.800405:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+5:13724:x1876716449534336:12345-0@lo:104: Request processed in 100us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.800411:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789776505.800478:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776505.800485:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:13724:x1876716449534464:12345-0@lo:104: 00010000:00010000:1.0:1789776505.800522:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800561:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776505.800567:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+4:13724:x1876716449534464:12345-0@lo:104: Request processed in 83us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.800574:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776505.800600:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776505.800607:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13724:x1876716449534592:12345-0@lo:104: 00010000:00010000:1.0:1789776505.800615:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800651:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776505.800656:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13724:x1876716449534592:12345-0@lo:104: Request processed in 50us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.800662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789776505.800680:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789776505.800686:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800693:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776505.800698:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800706:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776505.800715:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776505.800729:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776505.800763:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800771:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776505.800792:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800799:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9c00/0xf13b8042cb884aec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800810:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776505.800814:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800819:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776505.800822:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800828:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776505.800835:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776505.800840:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776505.800854:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800859:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776505.800883:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800888:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1200/0xf13b8042cb884ade lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ae5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800896:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776505.800898:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800903:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776505.800905:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800910:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776505.800915:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776505.800919:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776505.800933:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800939:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776505.800944:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800949:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f8400/0xf13b8042cb884ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ad7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776505.800956:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776505.800963:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776505.800965:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776505.800972:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776505.800979:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776505.800994:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449534848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776505.801030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.801068:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449534976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776505.801090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.801106:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789776505.801347:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776505.801358:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534848 00000100:00100000:3.0:1789776505.801363:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534848 00010000:00010000:3.0:1789776505.801386:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 24 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776505.801430:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534976 00000100:00100000:3.0:1789776505.801434:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534976 00010000:00010000:3.0:1789776505.801447:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 25 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776505.801467:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776505.801474:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3645:x1876716449534848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776505.801486:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776505.801515:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 25 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.801526:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 25 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.801543:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776505.801577:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3645:x1876716449534848:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776505.801584:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776505.801598:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776505.801604:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449534976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776505.801612:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776505.801617:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 24 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.801625:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 24 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.801636:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776505.801664:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449534976:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776505.801671:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776505.801718:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449534848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776505.802537:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449535104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776505.802837:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c0a00/0xf13b8042cb884af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884aec expref: 23 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.802853:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534336:0@lo:104: 00010000:00010000:2.0:1789776505.802865:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f9600/0xf13b8042cb884ae5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884ade expref: 22 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.802873:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534464:0@lo:104: 00000100:00100000:2.0:1789776505.802882:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534592:0@lo:104: 00000100:00100000:1.0:1789776505.802919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.802971:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449534976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776505.803030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535104 00000100:00100000:2.0:1789776505.803036:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535104 00010000:00010000:2.0:1789776505.803061:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.803096:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776505.803104:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3643:x1876716449535104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776505.803326:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776505.803345:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.803355:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.803370:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257a00/0xf13b8042cb884ad7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884ad0 expref: 22 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.803384:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776505.806980:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449534720 00000100:00100000:1.0:1789776505.806995:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449534720 00000100:00100000:1.0:1789776505.807041:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776505.807051:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13724:x1876716449534720:12345-0@lo:104: 00010000:00010000:1.0:1789776505.807070:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.808537:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789776505.808556:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789776505.808739:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3643:x1876716449535104:12345-0@lo:103:ldlm_bl.0 Request processed in 5629us (6150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776505.808751:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776505.808956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776505.809042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776505.809070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680448 00000100:00100000:3.0:1789776505.809076:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680448 00010000:00010000:3.0:1789776505.809119:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 13 pid: 6509 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776505.809146:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680576 00000100:00100000:3.0:1789776505.809149:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680576 00010000:00010000:3.0:1789776505.809162:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 14 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776505.809176:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1789776505.809184:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+14:2414:x1876716432680448:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776505.809198:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776505.809204:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 14 pid: 6509 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.809217:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 14 pid: 6509 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.809240:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776505.809293:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+14:2414:x1876716432680448:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776505.809301:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1789776505.809330:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1789776505.809337:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432680576:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776505.809347:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776505.809353:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 13 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.809364:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 13 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776505.809376:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776505.809398:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432680576:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 61us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776505.809405:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:0.0:1789776505.809791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449535104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776505.810640:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257400/0xf13b8042cb884b01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5703 expref: 12 pid: 6509 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.810656:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534080:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776505.810670:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257800/0xf13b8042cb884afa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56fc expref: 11 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.810680:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534208:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776505.811757:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776505.811770:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+3:13724:x1876716449534720:12345-0@lo:104: Request processed in 4718us (11569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.811780:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789776505.811867:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776505.811875:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.811885:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776505.811890:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.811900:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776505.811909:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776505.811929:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789776505.812006:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812013:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776505.812038:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812045:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256200/0xf13b8042cb884ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb884ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812060:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776505.812062:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776505.812064:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776505.812102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449535232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776505.812152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776505.812230:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535232 00000100:00100000:0.0:1789776505.812236:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535232 00010000:00010000:0.0:1789776505.812261:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 21 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.812289:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789776505.812297:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3645:x1876716449535232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776505.812309:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776505.812313:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 21 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812325:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 21 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812343:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812357:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812371:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812378:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812386:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812408:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812414:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776505.812433:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812441:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812449:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776505.812459:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776505.812488:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:3645:x1876716449535232:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776505.812517:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776505.812840:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449535232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776505.812919:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f9e00/0xf13b8042cb884ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb884ac2 expref: 20 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776505.812932:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1876716449534720:0@lo:104: 00010000:00010000:2.0:1789776505.812968:0:13724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.812978:0:13724:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.812994:0:13724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776505.813000:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f8800/0xf13b8042cb884c3c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776505.890625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449535360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776505.890645:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449535488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776505.896901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776505.896988:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535360 00000100:00100000:0.0:1789776505.896998:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535360 00000100:00100000:3.0:1789776505.897004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776505.897052:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535488 00000100:00100000:0.0:1789776505.897056:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535488 00000100:00100000:0.0:1789776505.897073:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789776505.897083:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449535360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776505.897387:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789776505.897398:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449535488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776505.897725:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776505.897786:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449535488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 390us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776505.897794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789776505.897913:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449535488:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776505.899671:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776505.904026:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449535360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6934us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776505.904044:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789776505.904172:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449535360:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789776506.275798:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789776506.710248:0:13774:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda105170 20000000:00000080:3.0:1789776506.710266:0:13774:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cff3f3800 uarg=0000000000000000 20000000:01000000:3.0:1789776506.710311:0:13774:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789776506.710319:0:13774:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789776506.710324:0:13774:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789776506.713000:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789776506.713223:0:13774:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789776506.713319:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789776506.713348:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789776506.713362:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789776506.713376:0:13774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776506.713395:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713425:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713435:0:13774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713442:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713450:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713473:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713480:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8e00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776506.713485:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713749:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713764:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713772:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.713779:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776506.859247:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776506.859255:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc1a65000 from 7 10000000:01000000:3.0:1789776506.859259:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776506.859301:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.859314:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.859326:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776506.859350:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776506.859426:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776506.866974:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535616 00000100:00100000:3.0:1789776506.866992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535616 00000100:00100000:3.0:1789776506.867149:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789776506.867160:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:6514:x1876716449535616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776506.867178:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776506.867197:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884c51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884c4a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.867229:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884c4a expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.867248:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884c4a expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.867258:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342cc00, rc 0) 00000100:00100000:3.0:1789776506.867330:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449535616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (7904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776506.867337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789776506.867549:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.867575:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776506.867593:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.867603:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776506.867684:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.867721:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.867743:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf50840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.869987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535744 00000100:00100000:0.0:1789776506.870001:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535744 00000100:00100000:0.0:1789776506.870057:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789776506.870067:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449535744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.870233:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449535744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.870241:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789776506.870902:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.870957:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.871024:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776506.871052:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449535872 00000100:00100000:0.0:1789776506.871056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449535872 00000100:00100000:0.0:1789776506.871082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789776506.871088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449535872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.871173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449535872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.871181:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789776506.871222:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedcfa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.871233:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449535872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.871481:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13787:1876716449536000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.871535:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776506.871554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536000 00000100:00100000:0.0:1789776506.871557:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536000 00000100:00100000:0.0:1789776506.871575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789776506.871582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:13787:x1876716449536000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.871650:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:13787:x1876716449536000:12345-0@lo:502:llog_process_th.0 Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.871658:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789776506.871686:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedcfa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.871698:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13787:1876716449536000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776506.871719:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776506.871728:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776506.871731:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789776506.871736:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc1a65000 00000020:00000080:2.0:1789776506.878582:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776506.878663:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776506.878669:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.878671:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776506.878675:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776506.878679:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.878681:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789776506.878686:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc1a65000 00000020:00000080:2.0:1789776506.878689:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776506.878757:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13787:1876716449536128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.878843:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.878887:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf50840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.884708:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536128 00000100:00100000:0.0:1789776506.884722:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536128 00000100:00100000:0.0:1789776506.884781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789776506.884791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:13787:x1876716449536128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.884980:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:13787:x1876716449536128:12345-0@lo:502:llog_process_th.0 Request processed in 191us (6136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.884989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789776506.891930:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13787:1876716449536128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776506.891978:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776506.891995:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.891998:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789776506.892004:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789776506.895185:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789776506.895228:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776506.895242:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.895254:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776506.895265:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776506.895268:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cfc247800 from 7 10000000:01000000:2.0:1789776506.895271:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776506.895309:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.895317:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.895328:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776506.895356:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.895436:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.895488:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.895579:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536256 00000100:00100000:0.0:1789776506.895587:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536256 00000100:00100000:0.0:1789776506.895644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789776506.895654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+21:6514:x1876716449536256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776506.895668:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776506.895681:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884c58 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.895704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884c58 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.895714:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884c58 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.895722:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8e00, rc 0) 00000100:00100000:0.0:1789776506.895767:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.895774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789776506.895857:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776506.895870:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.895879:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776506.895948:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.895975:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.896001:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.896042:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536384 00000100:00100000:0.0:1789776506.896046:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536384 00000100:00100000:0.0:1789776506.896078:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789776506.896085:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.896195:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.896202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789776506.896260:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.896288:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.896328:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.896351:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.896363:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536512 00000100:00100000:2.0:1789776506.896366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536512 00000100:00100000:2.0:1789776506.896388:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789776506.896407:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.896487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.896524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789776506.896565:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.896747:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13790:1876716449536640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.896782:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.896800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536640 00000100:00100000:2.0:1789776506.896803:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536640 00000100:00100000:2.0:1789776506.896823:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789776506.896829:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:13790:x1876716449536640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.896898:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:13790:x1876716449536640:12345-0@lo:502:llog_process_th.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.896914:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789776506.896949:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.896962:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13790:1876716449536640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776506.896982:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776506.896991:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.896994:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776506.897001:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cfc247800 00000020:00000080:2.0:1789776506.897003:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776506.897064:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776506.897068:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.897070:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776506.897073:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776506.897075:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.897077:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789776506.897081:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cfc247800 00000020:00000080:2.0:1789776506.897082:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776506.897114:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13790:1876716449536768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.897147:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.897165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536768 00000100:00100000:2.0:1789776506.897169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536768 00000100:00100000:2.0:1789776506.897189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789776506.897194:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:13790:x1876716449536768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.897249:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:13790:x1876716449536768:12345-0@lo:502:llog_process_th.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.897256:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789776506.897284:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.897295:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13790:1876716449536768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776506.897320:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776506.897324:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776506.897325:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789776506.897328:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789776506.897382:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789776506.897415:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776506.897424:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897434:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776506.897446:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776506.897448:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cd0f5c800 from 7 10000000:01000000:2.0:1789776506.897452:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776506.897471:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897480:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897488:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776506.897528:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.897556:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.897575:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.897586:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449536896 00000100:00100000:2.0:1789776506.897589:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449536896 00000100:00100000:2.0:1789776506.897609:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789776506.897621:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:6514:x1876716449536896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776506.897629:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776506.897640:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2e00/0xf13b8042cb884c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884c66 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897659:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2e00/0xf13b8042cb884c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884c66 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897668:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2e00/0xf13b8042cb884c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884c66 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897675:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2e00, rc 0) 00000100:00100000:2.0:1789776506.897704:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449536896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.897710:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789776506.897737:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449536896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776506.897747:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776506.897754:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776506.897796:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.897821:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.897833:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.897843:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537024 00000100:00100000:2.0:1789776506.897846:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537024 00000100:00100000:2.0:1789776506.897866:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789776506.897879:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449537024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.897965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449537024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.897972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789776506.898001:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.898024:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.898059:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776506.898071:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc52f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.898081:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537152 00000100:00100000:2.0:1789776506.898084:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537152 00000100:00100000:2.0:1789776506.898103:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789776506.898109:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449537152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.898167:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449537152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.898173:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789776506.898207:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789776506.903838:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789776506.910768:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13791:1876716449537280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.910854:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776506.910899:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc398840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.911232:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537280 00000100:00100000:2.0:1789776506.911241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537280 00000100:00100000:2.0:1789776506.911328:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789776506.911339:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:13791:x1876716449537280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776506.911559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:13791:x1876716449537280:12345-0@lo:502:llog_process_th.0 Request processed in 221us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.911568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789776506.911777:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13791:1876716449537280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776506.911809:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776506.911819:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.911821:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776506.911829:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cd0f5c800 00000020:00000080:1.0:1789776506.911832:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776506.911900:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776506.911904:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.911906:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776506.911909:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776506.911911:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.911913:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789776506.911916:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cd0f5c800 00000020:00000080:1.0:1789776506.911918:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776506.911960:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13791:1876716449537408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776506.912000:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776506.912023:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.912588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537408 00000100:00100000:0.0:1789776506.912594:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537408 00000100:00100000:0.0:1789776506.912631:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789776506.912639:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:13791:x1876716449537408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.912757:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:13791:x1876716449537408:12345-0@lo:502:llog_process_th.0 Request processed in 118us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.912765:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789776506.913216:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13791:1876716449537408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776506.913244:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776506.913250:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776506.913252:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789776506.913256:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789776506.913425:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789776506.913449:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776506.913459:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913470:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776506.913481:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776506.913483:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5cdb443800 from 7 10000000:01000000:0.0:1789776506.913486:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776506.913583:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913592:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913610:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776506.913630:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.913670:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776506.913691:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc398240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.913710:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537536 00000100:00100000:0.0:1789776506.913715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537536 00000100:00100000:0.0:1789776506.913746:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789776506.913754:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:6514:x1876716449537536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776506.913763:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776506.913775:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc25f8a00/0xf13b8042cb884c7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb884c74 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913799:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc25f8a00/0xf13b8042cb884c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb884c74 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913809:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc25f8a00/0xf13b8042cb884c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb884c74 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.913819:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8a00, rc 0) 00000100:00100000:0.0:1789776506.913894:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449537536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.913900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789776506.916266:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776506.916295:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776506.916308:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776506.916390:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.917472:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776506.917700:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776506.917916:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537664 00000100:00100000:2.0:1789776506.917934:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537664 00000100:00100000:2.0:1789776506.918009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789776506.918018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449537664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776506.918138:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449537664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776506.918146:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789776506.918371:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776506.918422:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776506.918470:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776506.918516:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.918600:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537792 00000100:00100000:0.0:1789776506.918609:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537792 00000100:00100000:0.0:1789776506.918640:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789776506.918647:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449537792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776506.918724:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:6514:x1876716449537792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.918731:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789776506.918831:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:6514:1876716449537792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776506.919994:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789776506.920427:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13795:1876716449537920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776506.920514:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776506.920552:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7fae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776506.921012:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449537920 00000100:00100000:0.0:1789776506.921020:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449537920 00000100:00100000:0.0:1789776506.921070:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789776506.921079:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:13795:x1876716449537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776506.921208:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:13795:x1876716449537920:12345-0@lo:502:llog_process_th.0 Request processed in 130us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776506.921218:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789776506.922744:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13795:1876716449537920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776506.922794:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776506.922804:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.922807:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776506.922815:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cdb443800 00000020:00000080:1.0:1789776506.922818:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776506.922944:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776506.922948:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.922950:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776506.922962:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776506.922966:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.922967:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789776506.922970:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5cdb443800 00000020:00000080:1.0:1789776506.922973:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776506.923814:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13795:1876716449538048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776506.924116:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776506.924165:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776506.927270:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538048 00000100:00100000:3.0:1789776506.927284:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538048 00000100:00100000:3.0:1789776506.927340:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789776506.927350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:13795:x1876716449538048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776506.928351:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:13795:x1876716449538048:12345-0@lo:502:llog_process_th.0 Request processed in 999us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776506.928361:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789776506.928583:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:13795:1876716449538048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776506.928620:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776506.928628:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776506.928630:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789776506.928635:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789776506.929679:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789776506.929706:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776506.929716:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776506.929728:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776507.298759:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776507.387080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776507.387177:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680704 00000100:00100000:2.0:1789776507.387188:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680704 00000100:00100000:2.0:1789776507.389516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 354 00000100:00100000:2.0:1789776507.389544:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:6182:x1876716432680704:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776507.389563:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776507.389589:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb884c82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5750 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776507.389621:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb884c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5750 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776507.389634:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb884c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5750 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776507.389644:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2800, rc 0) 00000100:00100000:2.0:1789776507.389724:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432680704:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 193us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.389732:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 354 00000100:00100000:2.0:1789776507.393309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776507.393404:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680832 00000100:00100000:3.0:1789776507.393413:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680832 00000100:00100000:3.0:1789776507.393472:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:3.0:1789776507.393483:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432680832:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776507.393789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432680832:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 306us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776507.393799:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:3.0:1789776507.404470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776507.405253:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432680960 00000100:00100000:2.0:1789776507.405265:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432680960 00000100:00100000:2.0:1789776507.405382:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:2.0:1789776507.405417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432680960:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776507.405604:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432680960:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 189us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.405613:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:1.0:1789776507.416460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776507.420541:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681088 00000100:00100000:3.0:1789776507.420630:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681088 00000100:00100000:3.0:1789776507.420696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00100000:3.0:1789776507.420707:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:10789:x1876716432681088:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776507.421096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:10789:x1876716432681088:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 389us (4643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776507.421105:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00100000:2.0:1789776507.426859:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449538176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776507.426938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776507.427027:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538176 00000100:00100000:1.0:1789776507.427037:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538176 00000100:00100000:1.0:1789776507.427106:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776507.427116:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449538176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776507.427161:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789776507.427198:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776507.427212:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449538176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776507.427218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789776507.427243:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449538176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776507.427335:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449538304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776507.427367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776507.429063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776507.429335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681216 00000100:00100000:2.0:1789776507.429344:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681216 00000100:00100000:1.0:1789776507.429475:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538304 00000100:00100000:1.0:1789776507.429480:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538304 00000100:00100000:1.0:1789776507.429553:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789776507.429562:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449538304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776507.429585:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776507.429643:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449538304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776507.429663:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789776507.430481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 358 00000100:00100000:2.0:1789776507.430510:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:10789:x1876716432681216:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776507.430649:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:10789:x1876716432681216:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 158us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.430656:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 358 00000100:00080000:3.0:1789776507.430732:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776507.430786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449538304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776507.439532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776507.448404:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681344 00000100:00100000:3.0:1789776507.448421:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681344 00000100:00100000:3.0:1789776507.448511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 359 00000100:00100000:3.0:1789776507.448524:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:6182:x1876716432681344:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776507.448541:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776507.448573:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc342c600/0xf13b8042cb884c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5757 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776507.448609:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc342c600/0xf13b8042cb884c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5757 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776507.448621:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc342c600/0xf13b8042cb884c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5757 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776507.448631:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c600, rc 0) 00000100:00100000:3.0:1789776507.448714:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432681344:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 192us (9219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776507.448721:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 359 00000100:00100000:1.0:1789776507.455601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776507.455790:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681472 00000100:00100000:2.0:1789776507.455800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681472 00000100:00100000:2.0:1789776507.455863:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 360 00000100:00100000:2.0:1789776507.455873:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432681472:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776507.456027:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432681472:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 154us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.456036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 360 00000100:00100000:2.0:1789776507.458589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776507.458671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681600 00000100:00100000:0.0:1789776507.458680:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681600 00000100:00100000:0.0:1789776507.458766:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 361 00000100:00100000:0.0:1789776507.458776:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432681600:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776507.458926:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:6182:x1876716432681600:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 150us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.458943:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 361 00000100:00100000:0.0:1789776507.467881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776507.468228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681728 00000100:00100000:3.0:1789776507.468241:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681728 00000100:00100000:3.0:1789776507.468322:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 362 00000100:00100000:3.0:1789776507.468334:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:10792:x1876716432681728:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776507.468603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:10792:x1876716432681728:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 270us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776507.468613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 362 00000100:00100000:1.0:1789776507.472425:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776507.476323:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681856 00000100:00100000:0.0:1789776507.476341:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681856 00000100:00100000:2.0:1789776507.478951:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 363 00000100:00100000:2.0:1789776507.478969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:10792:x1876716432681856:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776507.479918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:10792:x1876716432681856:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 949us (7506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.479928:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 363 00000100:00100000:0.0:1789776507.939182:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449538432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776507.939252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776507.939303:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538432 00000100:00100000:0.0:1789776507.939310:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538432 00000100:00100000:0.0:1789776507.939357:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776507.939365:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449538432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776507.939403:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776507.939447:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449538432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.939454:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1789776507.939490:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3478380 x1876716449538432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776507.939526:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449538432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776507.939543:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449538944:0@lo:400:kworker.0 00000100:00100000:0.0:1789776507.939568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776507.939586:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449539456:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939598:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449538688:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.939659:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449539200:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939681:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.939698:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449539712:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.939738:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789776507.939743:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449538560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776507.939764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.939783:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449539072:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939810:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538560 00000100:00100000:2.0:1789776507.939813:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538560 00000100:00100000:2.0:1789776507.939840:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789776507.939847:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449538560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776507.939858:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776507.939889:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449538560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.939895:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789776507.939916:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538688 00000100:00100000:2.0:1789776507.939920:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538688 00000100:00100000:2.0:1789776507.939955:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789776507.939962:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.939997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449538688:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940004:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789776507.940046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449538816:0@lo:400:kworker.0 00000100:00080000:2.0:1789776507.940079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776507.940094:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538944 00000100:00100000:2.0:1789776507.940097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538944 00000100:00100000:2.0:1789776507.940119:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539200 00000100:00100000:2.0:1789776507.940122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539200 00000100:00100000:0.0:1789776507.940127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940136:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789776507.940142:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449538944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776507.940153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449539968:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449538944:12345-0@lo:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.940175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940181:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789776507.940192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789776507.940195:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449538944:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449539200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940224:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449539200:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940229:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789776507.940231:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539712 00000100:00100000:0.0:1789776507.940234:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539712 00000100:00100000:2.0:1789776507.940257:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539456 00000100:00100000:0.0:1789776507.940259:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776507.940260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539456 00000100:00100000:0.0:1789776507.940265:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539968 00000100:00100000:2.0:1789776507.940289:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539968 00000100:00100000:0.0:1789776507.940295:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449539712:12345-0@lo:400:kworker.0 Request processed in 31us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.940301:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776507.940307:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789776507.940312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449539456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776507.940316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789776507.940322:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449539968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940359:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449539456:12345-0@lo:400:kworker.0 Request processed in 39us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940365:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1789776507.940404:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776507.940425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940446:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449539328:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940478:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449539840:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940562:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449538816 00000100:00100000:2.0:1789776507.940566:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449538816 00000100:00100000:2.0:1789776507.940583:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539328 00000100:00100000:2.0:1789776507.940586:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539328 00000100:00100000:0.0:1789776507.940594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449539968:12345-0@lo:400:kworker.0 Request processed in 271us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.940601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789776507.940602:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539840 00000100:00100000:2.0:1789776507.940605:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539840 00000100:00100000:2.0:1789776507.940619:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789776507.940625:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449538816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940661:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449538816:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940667:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789776507.940680:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789776507.940686:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940712:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449539328:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940718:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789776507.940730:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789776507.940735:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449539840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940781:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449539840:12345-0@lo:400:kworker.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.940787:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1789776507.940801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776507.940824:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449538816:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940834:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449539328:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449539840:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449539584:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940920:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449540096:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776507.940953:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449538688:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940962:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449539200:0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.940971:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449539712:0@lo:400:kworker.0 00010000:00080000:2.0:1789776507.940991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f71f80 x1876716449538560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776507.941004:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449538560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776507.941023:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539072 00000100:00100000:2.0:1789776507.941026:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539072 00000100:00100000:2.0:1789776507.941047:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789776507.941053:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449539072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776507.941096:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449539072:12345-0@lo:400:kworker.0 Request processed in 43us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.941102:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789776507.941125:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449539072:0@lo:400:kworker.0 00000040:00080000:3.0:1789776507.941135:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789776507.941160:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449539584 00000100:00100000:2.0:1789776507.941165:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449539584 00000100:00100000:2.0:1789776507.941189:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540096 00000100:00100000:2.0:1789776507.941192:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540096 00000100:00100000:0.0:1789776507.941205:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776507.941213:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776507.941253:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449539584:12345-0@lo:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.941390:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789776507.941398:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449540096:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789776507.941688:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35ce00 x1876716449539456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776507.941870:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449539456:0@lo:400:kworker.0 00010000:00080000:3.0:1789776507.941901:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc394380 x1876716449539968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776507.941910:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449539968:0@lo:400:kworker.0 00000100:00100000:3.0:1789776507.941971:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449539584:0@lo:400:kworker.0 00000040:00080000:1.0:1789776507.942083:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789776507.942244:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449540096:12345-0@lo:400:kworker.0 Request processed in 847us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776507.942252:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789776507.942928:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789776507.944550:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc397b80 x1876716449540096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776507.944570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449540096:0@lo:400:kworker.0 00010000:00010000:0.0:1789776508.323435:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776508.602652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776508.602697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776508.602740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776508.602778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776508.602804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776508.602837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776508.602886:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682112 00000100:00100000:2.0:1789776508.602886:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682624 00000100:00100000:3.0:1789776508.602909:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682112 00000100:00100000:2.0:1789776508.602909:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682624 00000100:00100000:0.0:1789776508.603005:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682368 00000100:00100000:3.0:1789776508.603012:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682240 00000100:00100000:0.0:1789776508.603012:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682368 00000100:00100000:3.0:1789776508.603020:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682240 00000100:00100000:0.0:1789776508.603070:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1789776508.603083:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682368:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776508.603141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682496 00000100:00100000:1.0:1789776508.603148:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682496 00000100:00100000:0.0:1789776508.603165:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682368:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 84us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776508.603173:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1789776508.604907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:0.0:1789776508.604929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776508.605014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 93us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776508.605021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:2.0:1789776508.609118:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:2.0:1789776508.609149:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432682624:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776508.609169:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:3.0:1789776508.609192:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682240:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776508.609417:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432682624:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 282us (6673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776508.609817:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00080000:2.0:1789776508.609866:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789776508.609969:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776508.609972:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776508.611253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:1.0:1789776508.612396:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432682496:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776508.612791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432681984 00000100:00100000:0.0:1789776508.612800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432681984 00000100:00100000:0.0:1789776508.612854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:0.0:1789776508.612863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432681984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776508.613023:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682240:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 3820us (10195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776508.613038:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:0.0:1789776508.618621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432681984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 5739us (15822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776508.618639:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:1.0:1789776508.618805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432682496:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 7539us (15967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776508.618816:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 208 00010000:00010000:1.0:1789776509.347208:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776510.370767:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776511.010896:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449540224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776511.010979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776511.011083:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540224 00000100:00100000:3.0:1789776511.011092:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540224 00000100:00100000:3.0:1789776511.011144:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789776511.012435:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449540224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776511.012522:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776511.012706:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449540224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1550us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776511.012716:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789776511.012794:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449540224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776511.014870:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449540352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776511.014942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776511.017009:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540352 00000100:00100000:3.0:1789776511.017021:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540352 00000100:00100000:3.0:1789776511.017092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789776511.017100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449540352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776511.017136:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789776511.018789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449540352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1682us (3839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776511.018802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789776511.021811:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449540352:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789776511.396165:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789776511.531154:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1789776512.418792:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776512.546816:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449540480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776512.546897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776512.546932:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540480 00000100:00100000:0.0:1789776512.546942:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540480 00000100:00100000:0.0:1789776512.547017:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789776512.547029:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449540480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776512.547058:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776512.547116:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449540480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776512.547123:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789776512.547183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776512.547265:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789776512.547271:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cc815d880, transno 4294967301 00000100:00100000:1.0:1789776512.547303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449540480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776512.548551:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449540608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776512.548601:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776512.548846:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540608 00000100:00100000:3.0:1789776512.548866:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540608 00000100:00100000:3.0:1789776512.548932:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789776512.548941:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449540608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776512.548960:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789776512.549031:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776512.551009:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449540608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2059us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776512.551024:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789776512.551033:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449540608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776513.058769:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776513.058806:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449540736:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.058898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776513.058974:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776513.058999:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449541120:0@lo:400:kworker.0 00000100:00100000:0.0:1789776513.059022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776513.059039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776513.059055:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776513.059065:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449540864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776513.059094:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776513.059099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776513.059104:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449541248:0@lo:400:kworker.0 00000100:00100000:0.0:1789776513.059150:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540992 00000100:00100000:0.0:1789776513.059158:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540992 00000100:00100000:0.0:1789776513.059225:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540864 00000100:00100000:0.0:1789776513.059229:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540864 00000100:00100000:3.0:1789776513.059242:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449540736 00000100:00100000:3.0:1789776513.059249:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449540736 00000100:00100000:0.0:1789776513.059253:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789776513.059264:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449540992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776513.059297:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789776513.059307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449540736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059351:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449540736:12345-0@lo:400:kworker.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.059358:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789776513.059428:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449541376:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789776513.059470:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776513.059487:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776513.059529:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541120 00000100:00100000:3.0:1789776513.059534:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541120 00000100:00100000:3.0:1789776513.059560:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541376 00000100:00100000:3.0:1789776513.059563:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541376 00000100:00100000:1.0:1789776513.059580:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449540864:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776513.059581:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789776513.059592:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449541120:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789776513.059609:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776513.059627:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449541120:12345-0@lo:400:kworker.0 Request processed in 37us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.059634:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789776513.059648:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789776513.059655:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449541376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776513.059661:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449540864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776513.059685:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776513.059705:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449541376:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.059712:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789776513.059760:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449541376:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059793:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776513.059799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449541504:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.059857:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776513.059865:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449541632:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.059928:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449541760:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.059949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.059986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449541888:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.060012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.060047:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776513.060053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449542016:0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.060074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.060108:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776513.060113:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449542144:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.060314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776513.060342:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449541120:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.060352:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449540736:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.060374:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541504 00000100:00100000:2.0:1789776513.060379:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541504 00000100:00100000:2.0:1789776513.060408:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541248 00000100:00100000:2.0:1789776513.060411:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541248 00000100:00100000:2.0:1789776513.060425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789776513.060431:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449541504:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789776513.060487:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f73100 x1876716449540864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776513.060523:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449540864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776513.060545:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541632 00000100:00100000:1.0:1789776513.060548:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541632 00000100:00100000:1.0:1789776513.060580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541760 00000100:00100000:1.0:1789776513.060583:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541760 00000100:00100000:1.0:1789776513.060607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789776513.060619:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449541632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.060662:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449541504:12345-0@lo:400:kworker.0 Request processed in 230us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.060669:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789776513.060684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789776513.060690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449541248:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789776513.060899:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776513.061595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776513.061653:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542144 00000100:00100000:3.0:1789776513.061659:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542144 00000100:00100000:3.0:1789776513.061692:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789776513.061700:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449541760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.061747:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449541760:12345-0@lo:400:kworker.0 Request processed in 48us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.061761:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789776513.061780:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449541632:12345-0@lo:400:kworker.0 Request processed in 1162us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.061790:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789776513.061810:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776513.061842:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449542144:12345-0@lo:400:kworker.0 Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.063333:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449541248:12345-0@lo:400:kworker.0 Request processed in 2637us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.063344:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789776513.063391:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449541888 00000100:00100000:2.0:1789776513.063400:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449541888 00000100:00100000:2.0:1789776513.063435:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542016 00000100:00100000:2.0:1789776513.063439:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542016 00000100:00100000:2.0:1789776513.063461:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776513.063469:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449541888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.063912:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449541888:12345-0@lo:400:kworker.0 Request processed in 442us (3897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.063919:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776513.063933:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776513.063940:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449542016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.063969:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449542016:12345-0@lo:400:kworker.0 Request processed in 30us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.063974:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776513.064019:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449542016:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064032:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449541888:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064044:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449541504:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064107:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449541248:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064462:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776513.064471:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449542272:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776513.064663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449542144:0@lo:400:kworker.0 00010000:00080000:2.0:1789776513.064682:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc34b4e00 x1876716449541760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776513.064692:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449541760:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449541632:0@lo:400:kworker.0 00000100:00100000:2.0:1789776513.064747:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542272 00000100:00100000:2.0:1789776513.064753:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542272 00000100:00100000:1.0:1789776513.064829:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789776513.064934:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789776513.064959:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5694us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.064966:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789776513.064973:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789776513.064980:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449542272:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789776513.064983:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776513.064990:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776513.065012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f71f80 x1876716449540992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776513.065032:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449542272:12345-0@lo:400:kworker.0 Request processed in 55us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776513.065033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776513.065047:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:2.0:1789776513.065067:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3fea00 x1876716449542272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776513.065079:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449542272:0@lo:400:kworker.0 00010000:00010000:3.0:1789776513.442668:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776513.722247:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776513.722357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776513.722397:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776513.722449:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683136 00000100:00100000:3.0:1789776513.722459:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683136 00000100:00100000:3.0:1789776513.722580:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:3.0:1789776513.722592:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432683136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:1.0:1789776513.722606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776513.722692:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432683136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776513.722699:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1789776513.725323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776513.725363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776513.725427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682752 00000100:00100000:1.0:1789776513.725566:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682752 00000100:00100000:2.0:1789776513.725606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432682880 00000100:00100000:2.0:1789776513.725612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432682880 00000100:00100000:1.0:1789776513.725625:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 367 00000100:00100000:1.0:1789776513.725635:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432682752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776513.725652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683392 00000100:00100000:2.0:1789776513.725656:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683392 00000100:00100000:2.0:1789776513.725677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:2.0:1789776513.725683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776513.725703:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432682752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776513.725711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 367 00000100:00100000:2.0:1789776513.725713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432682880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776513.725736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:2.0:1789776513.725748:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:2.0:1789776513.725754:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432683392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:1.0:1789776513.725776:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776513.725779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432683392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (3382us total) trans 0 rc 0/0 00000100:00080000:1.0:1789776513.725780:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776513.725785:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:0.0:1789776513.726864:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776513.726958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683008 00000100:00100000:1.0:1789776513.726967:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683008 00000100:00100000:3.0:1789776513.727016:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683264 00000100:00100000:3.0:1789776513.727023:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683264 00000100:00100000:1.0:1789776513.727040:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1789776513.727062:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432683008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776513.727137:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432683008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (1773us total) trans 0 rc 0/0 00000100:00080000:0.0:1789776513.727460:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776513.727464:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776513.735055:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1789776513.735128:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:1.0:1789776513.735149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432683264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776513.735858:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432683264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 705us (8984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776513.735868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 218 00010000:00010000:0.0:1789776514.466824:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776515.492551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776516.130862:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449542528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776516.130939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776516.131020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776516.131027:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449542400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776516.131052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776516.131121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542528 00000100:00100000:2.0:1789776516.131129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542528 00000100:00100000:0.0:1789776516.131173:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542400 00000100:00100000:0.0:1789776516.131178:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542400 00000100:00100000:2.0:1789776516.131182:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789776516.131190:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449542528:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776516.131197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789776516.131202:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449542400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776516.131232:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:2.0:1789776516.131245:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776516.131334:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449542528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776516.131341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789776516.133517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449542400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2304us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776516.133552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789776516.135852:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449542400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776516.135876:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449542528:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789776516.514783:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776517.155673:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789776517.159175:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789776517.539768:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776517.666829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776517.666870:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449542656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776517.667112:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776517.667279:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449542784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776517.670299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776517.670360:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542656 00000100:00100000:1.0:1789776517.670370:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542656 00000100:00080000:0.0:1789776517.670411:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776517.670416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776517.672567:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542784 00000100:00100000:2.0:1789776517.672580:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542784 00000100:00100000:2.0:1789776517.672641:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789776517.672651:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449542656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776517.672686:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776517.672762:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449542656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.672787:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789776517.672819:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789776517.672825:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449542784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776517.672835:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776517.672868:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449542784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.672874:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789776517.672931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449542784:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789776517.673091:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776517.673118:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449542656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776518.179444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789776518.179469:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449543040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776518.179557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.179626:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776518.179650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.179686:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543040 00000100:00100000:2.0:1789776518.179693:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543040 00000100:00100000:2.0:1789776518.179742:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449542912 00000100:00100000:2.0:1789776518.179746:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449542912 00000100:00100000:2.0:1789776518.179764:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776518.179772:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449543040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776518.179801:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776518.179847:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449543040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.179854:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776518.179870:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789776518.179876:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449542912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776518.179901:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776518.179935:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449542912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.179942:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789776518.179957:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789776518.179984:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc347b800 x1876716449543040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776518.180009:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449543040:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789776518.180025:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f6d80 x1876716449542912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776518.180037:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776518.180258:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449543424:0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.180291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776518.180323:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449543936:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.180438:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543424 00000100:00100000:1.0:1789776518.180443:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543424 00000100:00100000:1.0:1789776518.180469:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789776518.180476:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449543424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.180562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.180563:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789776518.180619:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449543552:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.180952:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449543424:12345-0@lo:400:kworker.0 Request processed in 475us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.180960:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789776518.181067:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449543296:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.181103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776518.181123:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449543808:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.181143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776518.181161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449544320:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776518.182522:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543936 00000100:00100000:1.0:1789776518.182529:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543936 00000100:00100000:1.0:1789776518.182580:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543296 00000100:00100000:1.0:1789776518.182582:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543296 00000100:00100000:1.0:1789776518.182593:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543808 00000100:00100000:1.0:1789776518.182595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543808 00000100:00100000:1.0:1789776518.182605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544320 00000100:00100000:1.0:1789776518.182607:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544320 00000100:00100000:1.0:1789776518.182621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789776518.182628:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449543936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449543936:12345-0@lo:400:kworker.0 Request processed in 50us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.182684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789776518.182710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789776518.182716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449543296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449543296:12345-0@lo:400:kworker.0 Request processed in 33us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.182755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789776518.182768:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789776518.182773:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449543808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182801:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449543808:12345-0@lo:400:kworker.0 Request processed in 28us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.182818:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789776518.182832:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789776518.182838:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449544320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182864:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449544320:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.182870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1789776518.182890:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776518.182894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776518.182921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449543296:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449543808:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.182942:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449544320:0@lo:400:kworker.0 00010000:00080000:0.0:1789776518.183549:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f71f80 x1876716449543936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776518.183562:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449543936:0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.183572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.183607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776518.183655:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449543424:0@lo:400:kworker.0 00000100:00100000:2.0:1789776518.183862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.183905:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449543680:0@lo:400:kworker.0 00000100:00100000:2.0:1789776518.183933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.183954:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449544192:0@lo:400:kworker.0 00000100:00100000:2.0:1789776518.183977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776518.184005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543680 00000100:00100000:2.0:1789776518.184010:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543680 00000100:00100000:2.0:1789776518.184041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789776518.184048:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449543680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776518.184089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449543680:12345-0@lo:400:kworker.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.184095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789776518.184104:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544192 00000100:00100000:1.0:1789776518.184108:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544192 00000100:00100000:2.0:1789776518.184135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449543680:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.184135:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776518.184141:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449544192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.184186:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449544192:12345-0@lo:400:kworker.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.184193:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776518.184214:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544448 00000100:00100000:2.0:1789776518.184216:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449544192:0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.184217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544448 00000100:00100000:1.0:1789776518.184249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789776518.184256:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449544448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.184297:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449544448:12345-0@lo:400:kworker.0 Request processed in 41us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.184303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1789776518.184326:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789776518.184341:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8859180 x1876716449544448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776518.184351:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.184414:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543168 00000100:00100000:0.0:1789776518.184418:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543168 00000100:00100000:0.0:1789776518.184452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789776518.184459:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449543168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776518.184518:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449543168:12345-0@lo:400:kworker.0 Request processed in 59us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776518.184534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789776518.184606:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789776518.185056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776518.185097:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449544064:0@lo:400:kworker.0 00000100:00100000:3.0:1789776518.185124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776518.185449:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449543552 00000100:00100000:1.0:1789776518.185455:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449543552 00000100:00100000:2.0:1789776518.185517:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544064 00000100:00100000:2.0:1789776518.185522:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544064 00000100:00100000:2.0:1789776518.185550:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776518.185557:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449544064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.185559:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789776518.185565:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449543552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776518.185602:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449543552:12345-0@lo:400:kworker.0 Request processed in 37us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.185609:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789776518.185842:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449544064:12345-0@lo:400:kworker.0 Request processed in 285us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.185849:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776518.185894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449543552:0@lo:400:kworker.0 00000100:00100000:2.0:1789776518.185905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449544064:0@lo:400:kworker.0 00010000:00010000:1.0:1789776518.563241:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776518.843435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776518.843484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776518.843540:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776518.843626:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776518.843662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776518.843678:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683904 00000100:00100000:2.0:1789776518.843688:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683904 00000100:00100000:2.0:1789776518.843749:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1789776518.843759:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776518.843844:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.843851:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1789776518.844003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683520 00000100:00100000:2.0:1789776518.844023:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683520 00000100:00100000:2.0:1789776518.844054:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 369 00000100:00100000:2.0:1789776518.844061:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432683520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776518.844093:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432683520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.844099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 369 00000100:00100000:1.0:1789776518.844123:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683648 00000100:00100000:1.0:1789776518.844135:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683648 00000100:00080000:2.0:1789776518.844161:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776518.844177:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776518.844178:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684160 00000100:00100000:1.0:1789776518.844182:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684160 00000100:00080000:2.0:1789776518.844199:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776518.844211:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:2.0:1789776518.844218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1789776518.844218:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776518.844224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776518.844251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.844254:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776518.844258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1789776518.844261:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:0.0:1789776518.847853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776518.848079:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432683776 00000100:00100000:1.0:1789776518.848089:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432683776 00000100:00100000:1.0:1789776518.848184:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684032 00000100:00100000:1.0:1789776518.848187:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684032 00000100:00100000:1.0:1789776518.848214:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:1.0:1789776518.848225:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776518.848300:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432683776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (4637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.848308:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:1.0:1789776518.848334:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:1.0:1789776518.848352:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776518.848375:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776518.848381:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00080000:2.0:1789776518.848786:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776518.848790:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789776519.586730:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776520.610687:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776521.250983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449544576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776521.251075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776521.251208:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544576 00000100:00100000:1.0:1789776521.251216:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544576 00000100:00100000:1.0:1789776521.251260:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789776521.251269:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449544576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776521.251306:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789776521.251366:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449544576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776521.251373:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789776521.251471:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449544576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776521.251717:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449544704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776521.251747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776521.251909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544704 00000100:00100000:0.0:1789776521.251914:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544704 00000100:00100000:0.0:1789776521.251946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789776521.251953:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449544704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776521.251973:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776521.252016:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449544704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776521.252022:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789776521.252162:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449544704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789776521.634795:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776522.659226:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776522.786999:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449544832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776522.787075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776522.788329:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776522.788345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449544960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776522.788394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776522.793517:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544832 00000100:00100000:2.0:1789776522.793534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544832 00000100:00100000:2.0:1789776522.793696:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449544960 00000100:00100000:2.0:1789776522.793700:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449544960 00000100:00100000:3.0:1789776522.794479:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789776522.794510:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449544832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776522.794548:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776522.794638:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449544832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (7562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776522.794645:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789776522.794710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449544832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776522.795067:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776522.795704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789776522.795723:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449544960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776522.795740:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776522.795816:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449544960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (7422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776522.795824:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789776522.795894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449544960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776523.298850:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776523.298870:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449545088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776523.298943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776523.299069:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545088 00000100:00100000:3.0:1789776523.299088:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545088 00000100:00100000:3.0:1789776523.299153:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789776523.299163:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449545088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789776523.299202:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776523.299259:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449545088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776523.299267:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1789776523.299310:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd885aa00 x1876716449545088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776523.299326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449545088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776523.299385:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449545216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776523.299413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789776523.299533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776523.299654:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545216 00000100:00100000:2.0:1789776523.299660:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545216 00000100:00080000:1.0:1789776523.299977:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776523.299990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449545344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300052:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449545856:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300107:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449546368:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300164:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776523.300169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449545472:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300207:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449545984:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300264:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545344 00000100:00100000:1.0:1789776523.300268:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545344 00000100:00100000:1.0:1789776523.300298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789776523.300306:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449545344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449545344:12345-0@lo:400:kworker.0 Request processed in 39us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.300352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789776523.300390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545856 00000100:00100000:1.0:1789776523.300394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545856 00000100:00100000:1.0:1789776523.300419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789776523.300425:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449545856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300458:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449545856:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.300464:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789776523.300484:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546368 00000100:00100000:1.0:1789776523.300487:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546368 00000100:00100000:1.0:1789776523.300538:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545472 00000100:00100000:1.0:1789776523.300541:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545472 00000100:00100000:1.0:1789776523.300556:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545984 00000100:00100000:1.0:1789776523.300559:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545984 00000100:00100000:1.0:1789776523.300572:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789776523.300578:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449546368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300620:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449546368:12345-0@lo:400:kworker.0 Request processed in 42us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.300627:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789776523.300641:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789776523.300647:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449545472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300672:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449545472:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.300678:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789776523.300690:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789776523.300696:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300734:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449545984:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.300739:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1789776523.300762:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776523.300764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776523.300783:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449545472:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300792:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449545984:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300799:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449545344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300806:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449545856:0@lo:400:kworker.0 00010000:00080000:1.0:1789776523.300816:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd885ca80 x1876716449546368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776523.300826:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449546368:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449545600:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300918:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449546112:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776523.300962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449545728:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.300982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.300998:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449546240:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776523.301035:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545600 00000100:00100000:1.0:1789776523.301039:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545600 00000100:00100000:1.0:1789776523.301063:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789776523.301070:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449545600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301118:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449545600:12345-0@lo:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.301123:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789776523.301140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546112 00000100:00100000:1.0:1789776523.301144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546112 00000100:00100000:1.0:1789776523.301163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449545728 00000100:00100000:1.0:1789776523.301166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449545728 00000100:00100000:1.0:1789776523.301174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546240 00000100:00100000:1.0:1789776523.301177:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546240 00000100:00100000:1.0:1789776523.301188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789776523.301194:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449546112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449546112:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.301229:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789776523.301242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789776523.301255:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449545728:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.301290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789776523.301304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789776523.301310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449546240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301335:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449546240:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.301340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1789776523.301357:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776523.301359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776523.301378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449545728:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301387:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449546240:0@lo:400:kworker.0 00000100:00100000:1.0:1789776523.301396:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449545600:0@lo:400:kworker.0 00010000:00080000:1.0:1789776523.301407:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd885ce00 x1876716449546112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776523.301416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449546112:0@lo:400:kworker.0 00000100:00100000:2.0:1789776523.301650:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776523.301666:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449545216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776523.301682:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776523.301743:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449545216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776523.306032:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1789776523.308160:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff464e00 x1876716449545216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776523.308188:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449545216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776523.682962:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776523.964743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776523.964790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776523.964876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776523.964892:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684288 00000100:00100000:1.0:1789776523.964903:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684288 00000100:00100000:1.0:1789776523.964967:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 371 00000100:00100000:1.0:1789776523.964977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432684288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776523.965079:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432684288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 103us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.965088:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 371 00000100:00100000:3.0:1789776523.965892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684544 00000100:00100000:1.0:1789776523.965896:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684416 00000100:00100000:1.0:1789776523.965900:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684416 00000100:00100000:3.0:1789776523.965901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684544 00000100:00080000:0.0:1789776523.966100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776523.966107:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776523.972870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1789776523.972898:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1789776523.973055:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432684416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776523.973164:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432684416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 124us (8287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776523.973380:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432684544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776523.973622:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2414:x1876716432684544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 246us (8830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776523.974816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:3.0:1789776523.974862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1789776523.987596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776523.987757:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684672 00000100:00100000:0.0:1789776523.987768:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684672 00000100:00100000:0.0:1789776523.987861:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1789776523.987874:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432684672:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:0.0:1789776523.987908:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884bb0 00000100:00080000:0.0:1789776523.987917:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5bc37d2000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789776523.988050:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789776523.988107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789776523.988299:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789776523.988488:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+2:2410:x1876716432684672:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 615us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776523.988538:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1789776523.991386:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776523.993169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776523.993294:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684800 00000100:00100000:2.0:1789776523.993305:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684800 00000100:00100000:2.0:1789776523.993385:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432684928 00000100:00100000:2.0:1789776523.993389:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432684928 00000100:00100000:2.0:1789776523.993421:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:2.0:1789776523.993435:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776523.993487:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:3.0:1789776523.993554:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776523.993555:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 120us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776523.993583:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:3.0:1789776523.993639:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432684928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 101us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776523.993663:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00080000:0.0:1789776523.994309:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776523.994315:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776524.706742:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776525.731538:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776526.370786:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776526.370822:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449546496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776526.370837:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449546624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776526.370937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776526.370978:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546496 00000100:00100000:1.0:1789776526.370987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546496 00000100:00100000:1.0:1789776526.371079:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789776526.371098:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449546496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776526.371132:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776526.371151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776526.371196:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449546496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776526.371268:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449546496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776526.371312:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546624 00000100:00100000:2.0:1789776526.371318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546624 00000100:00100000:1.0:1789776526.374227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789776526.374588:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789776526.374618:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449546624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776526.374674:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789776526.374853:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449546624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 249us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776526.374861:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789776526.375065:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449546624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789776526.754719:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789776527.396281:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789776527.396648:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789776527.781152:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776527.906640:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449546752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776527.906712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776527.906806:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546752 00000100:00100000:3.0:1789776527.906815:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546752 00000100:00100000:1.0:1789776527.906825:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449546880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776527.906863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776527.906875:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449546880 00000100:00100000:3.0:1789776527.906879:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449546880 00000100:00100000:3.0:1789776527.906907:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789776527.906918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449546752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776527.906924:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776527.906936:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449546880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776527.906950:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789776527.906951:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776527.907105:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449546880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776527.907112:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776527.907157:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449546880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776527.909021:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449546752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2097us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776527.909034:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1789776527.909061:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776527.909104:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449546752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776528.418687:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776528.418735:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776528.418831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.418944:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547008 00000100:00100000:1.0:1789776528.418967:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547008 00000100:00100000:1.0:1789776528.419051:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789776528.419063:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449547008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776528.419103:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776528.419155:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449547008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776528.419214:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449547136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776528.419251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776528.419435:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547136 00000100:00100000:3.0:1789776528.419441:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547136 00000100:00100000:3.0:1789776528.419468:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776528.419475:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449547136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776528.419484:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00002000:00000024:3.0:1789776528.419488:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789776528.419556:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776528.419566:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449547136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776528.419575:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1789776528.419600:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8858700 x1876716449547008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789776528.419612:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8858a80 x1876716449547136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776528.419629:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776528.419632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449547136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776528.419705:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776528.419716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449547264:0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.419767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.419806:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449547776:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.419842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.419888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449548288:0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.419911:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449547648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.419946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.419994:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547264 00000100:00100000:1.0:1789776528.419999:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547264 00000100:00100000:1.0:1789776528.420029:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789776528.420036:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449547264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.420068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449547264:12345-0@lo:400:kworker.0 Request processed in 33us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776528.420075:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789776528.420110:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449547520:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.420144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.420159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449548032:0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.420209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776528.420229:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449548160:0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.420256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776528.420316:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547776 00000100:00100000:2.0:1789776528.420321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547776 00000100:00100000:2.0:1789776528.420355:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547520 00000100:00100000:2.0:1789776528.420358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547520 00000100:00100000:0.0:1789776528.420363:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449547264:0@lo:400:kworker.0 00000100:00100000:2.0:1789776528.420376:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789776528.420388:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.420408:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776528.420438:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789776528.420445:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449547776:12345-0@lo:400:kworker.0 Request processed in 57us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776528.420447:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449547392:0@lo:400:kworker.0 00000100:00100000:2.0:1789776528.420458:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789776528.420474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789776528.420479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776528.420483:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449547520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776528.420733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449547520:12345-0@lo:400:kworker.0 Request processed in 253us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776528.420748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789776528.420829:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449547904:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.420857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776528.420859:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548288 00000100:00100000:0.0:1789776528.420866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548288 00000100:00100000:1.0:1789776528.420878:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449547520:0@lo:400:kworker.0 00000100:00080000:1.0:1789776528.420905:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776528.420942:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547648 00000100:00100000:1.0:1789776528.420946:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547648 00000100:00100000:0.0:1789776528.421007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548160 00000100:00100000:0.0:1789776528.421011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548160 00000100:00100000:1.0:1789776528.421041:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548032 00000100:00100000:1.0:1789776528.421046:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548032 00000100:00100000:1.0:1789776528.421062:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547392 00000100:00100000:1.0:1789776528.421064:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547392 00000100:00100000:1.0:1789776528.421076:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449547904 00000100:00100000:1.0:1789776528.421078:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449547904 00000100:00100000:1.0:1789776528.421091:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789776528.421098:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449548288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.421133:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449548288:12345-0@lo:400:kworker.0 Request processed in 35us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776528.421139:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789776528.421153:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789776528.421159:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.421310:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449547648:12345-0@lo:400:kworker.0 Request processed in 151us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776528.422283:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789776528.422317:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.422406:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449548032:12345-0@lo:400:kworker.0 Request processed in 100us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776528.424696:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789776528.424712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789776528.424741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449547392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.424758:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789776528.424774:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449547904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776528.424841:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789776528.424854:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449548160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776528.426398:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:0.0:1789776528.426866:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776528.426874:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776528.427607:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449547392:12345-0@lo:400:kworker.0 Request processed in 2876us (7121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776528.427623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789776528.428299:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449548160:12345-0@lo:400:kworker.0 Request processed in 3443us (8036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776528.428311:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789776528.428406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449547776:0@lo:400:kworker.0 00010000:00080000:2.0:1789776528.428433:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3479f80 x1876716449548288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776528.428448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449548288:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.433781:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449547904:12345-0@lo:400:kworker.0 Request processed in 8998us (12909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776528.433802:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789776528.434413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449547392:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.434430:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449547904:0@lo:400:kworker.0 00010000:00080000:1.0:1789776528.434447:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3479500 x1876716449548032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776528.434460:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449548032:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.434544:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449547648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776528.434557:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449548160:0@lo:400:kworker.0 00010000:00010000:0.0:1789776528.804562:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776529.085793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776529.086028:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685056 00000100:00100000:1.0:1789776529.086038:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685056 00000100:00100000:1.0:1789776529.086101:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:1.0:1789776529.086112:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432685056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776529.086189:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432685056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776529.086207:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 373 00000100:00100000:2.0:1789776529.088815:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776529.088844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776529.088869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776529.088892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776529.088916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685184 00000100:00100000:2.0:1789776529.088924:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685184 00000100:00100000:2.0:1789776529.088987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685440 00000100:00100000:2.0:1789776529.088991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685440 00000100:00100000:2.0:1789776529.089003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685312 00000100:00100000:2.0:1789776529.089006:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685312 00000100:00100000:2.0:1789776529.089017:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685568 00000100:00100000:2.0:1789776529.089019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685568 00000100:00100000:2.0:1789776529.089032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:2.0:1789776529.089041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432685184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776529.089121:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432685184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776529.089147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:2.0:1789776529.089163:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1789776529.089169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432685440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776529.089195:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432685440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776529.089201:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1789776529.089211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:2.0:1789776529.089216:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432685312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776529.089252:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432685312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776529.089259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:2.0:1789776529.089270:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:2.0:1789776529.089276:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432685568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776529.089298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432685568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776529.089303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00080000:0.0:1789776529.090759:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776529.090766:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776529.827618:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789776529.958961:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776529.958971:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5bc3c80000/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:3.0:1789776529.959079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc3c80000/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-OST0000 00000020:00000080:3.0:1789776529.959727:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc37d2000 for lustre-OST0000 00010000:00010000:0.0:1789776530.851187:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789776531.328767:0:14056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:08:51 (1789776531) 00000100:00100000:0.0:1789776531.490933:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449548416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776531.491017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776531.491129:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548416 00000100:00100000:2.0:1789776531.491137:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548416 00000100:00100000:2.0:1789776531.491195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789776531.491205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449548416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776531.491239:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776531.491295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449548416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776531.491333:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449548416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776531.491381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789776531.491540:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449548544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776531.491571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776531.492077:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548544 00000100:00100000:0.0:1789776531.492083:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548544 00000100:00100000:0.0:1789776531.492117:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789776531.492135:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449548544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776531.492160:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789776531.492215:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449548544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776531.492222:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789776531.492413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449548544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789776531.874983:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776532.869320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776532.871036:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685696 00000100:00100000:2.0:1789776532.871058:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685696 00000100:00100000:2.0:1789776532.871185:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1789776532.871202:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:11082:x1876716432685696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776532.871228:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776532.871260:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab575e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871361:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871379:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871395:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776532.871464:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776532.871470:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776532.871564:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871598:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab575e expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871622:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab575e expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776532.871653:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121800) 00010000:00010000:2.0:1789776532.871656:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776532.871662:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00080000:0.0:1789776532.872168:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776532.872234:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:11082:x1876716432685696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1035us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776532.872244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1789776532.883600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776532.883725:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685824 00000100:00100000:0.0:1789776532.883736:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685824 00000100:00100000:0.0:1789776532.883801:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1789776532.883811:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:11083:x1876716432685824:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776532.883832:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776532.883853:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5765 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883936:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883952:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883962:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883976:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883983:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.883989:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884046:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884054:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884091:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776532.884135:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789776532.884139:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776532.884162:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884173:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884180:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884187:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884193:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776532.884198:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884206:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884218:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121800) 00010000:00010000:0.0:1789776532.884221:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776532.884226:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884232:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884258:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884264:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884271:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884276:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776532.884280:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884286:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884294:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a5cf512dc00) 00010000:00010000:0.0:1789776532.884297:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776532.884300:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884306:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884338:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5765 expref: 8 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884351:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5765 expref: 7 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.884369:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5cf512d500) 00010000:00010000:0.0:1789776532.884372:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776532.884374:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8800, rc 0) 00000100:00100000:0.0:1789776532.884443:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11083:x1876716432685824:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 632us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776532.884452:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1789776532.893617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776532.896633:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432685952 00000100:00100000:3.0:1789776532.896657:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432685952 00000100:00100000:3.0:1789776532.896766:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1789776532.896781:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11083:x1876716432685952:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789776532.896926:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11083:x1876716432685952:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 147us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776532.896935:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00010000:00010000:3.0:1789776532.898651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776532.902536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776532.902683:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686208 00000100:00100000:0.0:1789776532.902699:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686208 00000100:00100000:0.0:1789776532.903129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:0.0:1789776532.903142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11083:x1876716432686208:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776532.903163:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776532.903199:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884cba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab576c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903296:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903307:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903323:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903330:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903354:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903460:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884ccf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903469:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884ccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903477:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884ccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776532.903486:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789776532.903617:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903625:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903631:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903638:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776532.903642:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903651:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903664:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5cf512d500) 00010000:00010000:0.0:1789776532.903667:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776532.903677:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903683:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb884cc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903698:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903705:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903711:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903717:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776532.903720:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903725:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903746:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a5cf512dc00) 00010000:00010000:0.0:1789776532.903749:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776532.903752:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.903758:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb884cc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.904043:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884cba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab576c expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.904074:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884ccf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab576c expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776532.904080:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:0.0:1789776532.904083:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776532.904085:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8c00, rc 0) 00000100:00100000:0.0:1789776532.904167:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11083:x1876716432686208:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1029us (1646us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789776532.904176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1789776532.908422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776532.908650:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686336 00000100:00100000:3.0:1789776532.908663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686336 00000100:00100000:3.0:1789776532.908824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1789776532.908835:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11083:x1876716432686336:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789776532.908964:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11083:x1876716432686336:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 131us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776532.908972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1789776532.913464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776532.913637:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686464 00000100:00100000:2.0:1789776532.913653:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686464 00000100:00100000:2.0:1789776532.913725:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00080000:0.0:1789776532.913822:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776532.913856:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:11083:x1876716432686464:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789776532.924404:0:13443:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10491us 00000100:00100000:2.0:1789776532.936251:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:11083:x1876716432686464:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 22506us (22787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776532.936265:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1789776533.026696:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776533.026720:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449548672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776533.026807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776533.026885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548672 00000100:00100000:2.0:1789776533.026904:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548672 00000100:00100000:2.0:1789776533.026978:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789776533.026988:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449548672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776533.027020:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776533.027070:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449548672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776533.027078:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789776533.027104:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776533.027115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776533.027140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776533.027193:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449548672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776533.037341:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548800 00000100:00100000:2.0:1789776533.037356:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548800 00000100:00100000:2.0:1789776533.037526:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789776533.037537:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449548800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776533.037565:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776533.037656:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449548800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (10514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776533.037664:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789776533.037715:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449548800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789776533.037791:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776533.541914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449549184:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.541982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776533.542024:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449549696:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.542041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776533.542064:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776533.542069:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449549312:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.542087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776533.542102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449549824:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.542118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776533.542146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549312 00000100:00100000:1.0:1789776533.542153:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549312 00000100:00100000:1.0:1789776533.542191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789776533.542199:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449549312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.542242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449549312:12345-0@lo:400:kworker.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776533.542248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789776533.542280:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449549312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449549056:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542416:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449549568:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542460:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449550080:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542514:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789776533.542521:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776533.542542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449549440:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449549952:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542601:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542616:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449550336:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542649:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776533.542653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449550208:0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776533.542689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549184 00000100:00100000:3.0:1789776533.542693:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549184 00000100:00100000:3.0:1789776533.542712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549696 00000100:00100000:3.0:1789776533.542714:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549696 00000100:00100000:3.0:1789776533.542733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549824 00000100:00100000:3.0:1789776533.542735:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549824 00000100:00100000:3.0:1789776533.542744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449550080 00000100:00100000:3.0:1789776533.542746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449550080 00000100:00100000:3.0:1789776533.542755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549440 00000100:00100000:3.0:1789776533.542757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549440 00000100:00100000:3.0:1789776533.542765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549952 00000100:00100000:3.0:1789776533.542767:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549952 00000100:00100000:3.0:1789776533.542778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789776533.542789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449549184:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.542823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789776533.542837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789776533.542842:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542860:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449549696:12345-0@lo:400:kworker.0 Request processed in 18us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.542864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789776533.542872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789776533.542876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449549824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449549824:12345-0@lo:400:kworker.0 Request processed in 36us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.542918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789776533.542929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789776533.542934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449550080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.542962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449550080:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.542968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789776533.542979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789776533.542984:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449549440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.543007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449549440:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.543013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789776533.543023:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789776533.543121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.543152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449549952:12345-0@lo:400:kworker.0 Request processed in 33us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.543158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789776533.543178:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549056 00000100:00100000:3.0:1789776533.543182:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549056 00000100:00100000:3.0:1789776533.543208:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789776533.543214:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.543242:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449549056:12345-0@lo:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.543247:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789776533.543273:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449549568 00000100:00100000:3.0:1789776533.543276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449549568 00000100:00100000:3.0:1789776533.543295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789776533.543301:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449549568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776533.543329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449549568:12345-0@lo:400:kworker.0 Request processed in 28us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.543335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789776533.543354:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449548928 00000100:00100000:3.0:1789776533.543357:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449548928 00000100:00100000:3.0:1789776533.543380:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789776533.543385:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449548928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776533.543406:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776533.543430:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449548928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.543435:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1789776533.543538:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff464380 x1876716449549824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776533.543551:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449549824:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.543561:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449549184:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.543570:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449549696:0@lo:400:kworker.0 00000040:00080000:0.0:1789776533.544372:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789776533.544435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449550464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776533.544471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776533.544535:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449550464 00000100:00100000:0.0:1789776533.544540:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449550464 00000100:00100000:0.0:1789776533.544564:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789776533.544570:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449550464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776533.544583:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776533.544614:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449550464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776533.544620:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1789776533.544648:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd885dc00 x1876716449550464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776533.544663:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449550464:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789776533.544723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd881dc00 x1876716449548928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776533.544737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776533.544749:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449549440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776533.544761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449549952:0@lo:400:kworker.0 00000100:00100000:0.0:1789776533.544771:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449549056:0@lo:400:kworker.0 00000100:00100000:0.0:1789776533.544782:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449549568:0@lo:400:kworker.0 00010000:00080000:0.0:1789776533.545653:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff464e00 x1876716449550080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776533.545666:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449550080:0@lo:400:kworker.0 00000100:00080000:0.0:1789776533.545703:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776533.545709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776533.545712:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776533.545726:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449550336 00000100:00100000:0.0:1789776533.545732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449550336 00000100:00100000:0.0:1789776533.545810:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449550208 00000100:00100000:0.0:1789776533.545814:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449550208 00000040:00080000:2.0:1789776533.546164:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776533.549020:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776533.549059:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449550336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776533.549230:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776533.549240:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449550208:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789776533.549360:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3ccf100 x1876716449550336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776533.549375:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449550336:0@lo:400:kworker.0 00000100:00100000:1.0:1789776533.550388:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449550336:12345-0@lo:400:kworker.0 Request processed in 1335us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776533.550399:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789776533.550484:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449550208:12345-0@lo:400:kworker.0 Request processed in 1246us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776533.550510:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1789776533.550875:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3cced80 x1876716449550208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776533.550900:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449550208:0@lo:400:kworker.0 00010000:00010000:0.0:1789776533.922677:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776534.203827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776534.204132:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686592 00000100:00100000:3.0:1789776534.204141:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686592 00000100:00100000:3.0:1789776534.204191:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00100000:3.0:1789776534.204200:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432686592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776534.204261:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432686592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 62us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776534.204269:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 375 00000100:00100000:0.0:1789776534.204823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.204861:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.204914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.204938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.204959:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686848 00000100:00100000:0.0:1789776534.204964:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686848 00000100:00100000:0.0:1789776534.205003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432687104 00000100:00100000:0.0:1789776534.205005:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432687104 00000100:00100000:0.0:1789776534.205016:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686720 00000100:00100000:0.0:1789776534.205019:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686720 00000100:00100000:0.0:1789776534.205030:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432686976 00000100:00100000:1.0:1789776534.205115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1789776534.205126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432686848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776534.205170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432686848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.205177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1789776534.205194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:1.0:1789776534.205200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432687104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776534.205219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432687104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.205225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:1.0:1789776534.205235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:1.0:1789776534.205240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432686720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776534.205260:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432686720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.205266:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00080000:1.0:1789776534.205358:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776534.205363:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776534.205594:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432686976 00000100:00100000:1.0:1789776534.205688:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:1.0:1789776534.205695:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432686976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776534.205724:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432686976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.205738:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00080000:0.0:1789776534.205994:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776534.707813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776534.707922:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432687232 00000100:00100000:2.0:1789776534.707932:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432687232 00000100:00100000:2.0:1789776534.707996:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1789776534.708007:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11125:x1876716432687232:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776534.708035:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776534.708059:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5773 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708128:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708144:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708155:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708171:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708179:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708186:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708227:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708235:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708242:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708249:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776534.708260:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708268:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708282:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121800) 00010000:00010000:2.0:1789776534.708285:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776534.708290:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708298:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708313:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708319:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708325:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708330:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776534.708332:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708337:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708344:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a5bc1a87500) 00010000:00010000:2.0:1789776534.708347:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776534.708356:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708363:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884ceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708397:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884cdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5773 expref: 10 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708409:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121800) 00010000:00010000:2.0:1789776534.708411:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776534.708415:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5773 expref: 10 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.708425:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776534.708569:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11125:x1876716432687232:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 563us (765us total) trans 0 rc 301/301 00000100:00100000:2.0:1789776534.708578:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:1.0:1789776534.717664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776534.717814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432687488 00000100:00100000:2.0:1789776534.717824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432687488 00000100:00100000:2.0:1789776534.717887:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1789776534.717899:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11125:x1876716432687488:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1789776534.717972:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776534.717999:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab575e expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718017:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2121800) 00010000:00010000:2.0:1789776534.718026:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776534.718093:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718107:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718117:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718130:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718137:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718144:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718642:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718653:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718661:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776534.718677:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e82c6aa8 reply state 0000000009929c04 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718694:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776534.718703:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776534.718706:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789776534.718711:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789776534.718733:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718741:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718748:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718754:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776534.718758:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718766:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718775:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776534.718778:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776534.718781:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718788:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884cf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776534.718809:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e82c6aa8 reply state 0000000009929c04 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718818:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.718836:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a5bc1a87900) 00010000:00010000:2.0:1789776534.718839:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776534.718841:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789776534.718960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:11125:x1876716432687488:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 1062us (1304us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789776534.718968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1789776534.789175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776534.789278:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432687616 00000100:00100000:1.0:1789776534.789287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432687616 00000100:00100000:1.0:1789776534.789355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1789776534.789366:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:11133:x1876716432687616:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:1.0:1789776534.789393:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776534.789416:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884d07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab577a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789489:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789545:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789559:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776534.789614:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789776534.789618:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776534.789659:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789685:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab577a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789711:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab577a expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.789748:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:1.0:1789776534.789751:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776534.789755:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0e00, rc 0) 00000100:00100000:1.0:1789776534.789821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:11133:x1876716432687616:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 455us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.789828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1789776534.857219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776534.857332:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432687744 00000100:00100000:1.0:1789776534.857347:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432687744 00000100:00100000:1.0:1789776534.857435:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1789776534.857448:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:11139:x1876716432687744:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776534.857472:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776534.857601:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5781 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857671:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857687:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857710:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857730:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857738:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857765:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857865:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857874:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.857882:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776534.858254:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789776534.858260:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776534.858315:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858331:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858337:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858343:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858349:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776534.858354:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858361:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858383:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:1.0:1789776534.858386:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776534.858392:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858399:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884d1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858415:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858422:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858428:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858432:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776534.858434:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858439:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858446:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a5bc1a87900) 00010000:00010000:1.0:1789776534.858448:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776534.858451:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858456:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884d23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858595:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5781 expref: 13 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858612:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5781 expref: 12 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.858619:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776534.858621:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789776534.858624:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1200, rc 0) 00000100:00100000:1.0:1789776534.858703:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:11139:x1876716432687744:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1256us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.858722:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1789776534.865269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776534.865455:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688000 00000100:00100000:2.0:1789776534.865470:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688000 00000100:00100000:2.0:1789776534.865587:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1789776534.865601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:11139:x1876716432688000:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776534.865630:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776534.865658:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884d31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5788 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865801:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865825:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865839:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865868:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865875:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.865907:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776534.866674:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789776534.866996:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867011:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867100:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867150:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867158:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867165:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867172:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776534.867178:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867187:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867202:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776534.867205:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776534.867226:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884d38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776534.867251:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e45f9a4 reply state 000000002c77da26 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867263:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867269:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776534.867272:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776534.867275:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789776534.867318:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884d31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867334:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776534.867342:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:2.0:1789776534.867345:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776534.867347:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3200, rc 0) 00000100:00100000:2.0:1789776534.867529:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:11139:x1876716432688000:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1928us (2271us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789776534.867540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1789776534.871229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.871406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688128 00000100:00100000:0.0:1789776534.871421:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688128 00000100:00100000:0.0:1789776534.871486:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1789776534.871538:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2410:x1876716432688128:12345-192.168.204.27@tcp:8:bash.0 00010000:00080000:0.0:1789776534.871589:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:0.0:1789776534.871634:0:8432:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb884d54 00002000:00100000:0.0:1789776534.871649:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1c6b552f-1300-40e3-a848-4343cb28ffe2/ffff8a5cd884d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789776534.871674:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789776534.871782:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789776534.871822:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8a5cd884f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776534.871921:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432688128:12345-192.168.204.27@tcp:8:bash.0 Request processed in 385us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776534.871930:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1789776534.874387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776534.874919:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688256 00000100:00100000:1.0:1789776534.874931:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688256 00000100:00100000:1.0:1789776534.875049:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1789776534.875060:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432688256:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776534.875083:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776534.875112:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab578f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776534.875143:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789776534.875166:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1789776534.875171:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776534.875182:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.875235:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.875252:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0200, rc 0) 00000100:00100000:1.0:1789776534.875325:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:0:x1876716432688256:12345-192.168.204.27@tcp:101:bash.0 Request processed in 266us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776534.875332:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00080000:2.0:1789776534.876235:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776534.879322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.879463:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688384 00000100:00100000:0.0:1789776534.879476:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688384 00000100:00100000:0.0:1789776534.879746:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776534.879758:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11139:x1876716432688384:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1789776534.879792:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776534.879820:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5796 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.879874:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.879885:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776534.879889:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776534.879895:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.879940:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.879955:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776534.879973:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876716449550592:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776534.880537:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776534.886409:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876716449550592:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776534.886460:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.886509:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9400, rc 0) 00000100:00100000:0.0:1789776534.886803:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:11139:x1876716432688384:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7044us (7492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776534.886814:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:2.0:1789776534.887130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776534.888372:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688512 00000100:00100000:0.0:1789776534.888389:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688512 00010000:00010000:0.0:1789776534.888445:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776534.888566:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1789776534.888579:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432688512:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776534.888599:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776534.888628:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.888645:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.888678:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb9fc44/0xf13b8042cb884d5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab578f expref: 8 pid: 8434 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.888697:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776534.888701:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776534.888711:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.888722:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776534.888784:0:7458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776534.888801:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7458:1876716449550720:192.168.204.27@tcp:105: 00000100:00100000:0.0:1789776534.888918:0:7458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776534.891960:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd885aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7458:1876716449550720:192.168.204.27@tcp:105: 00010000:00010000:0.0:1789776534.891998:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776534.892202:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432688512:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3623us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776534.892215:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1789776534.895937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776534.896209:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432688768 00000100:00100000:2.0:1789776534.896222:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432688768 00000100:00100000:2.0:1789776534.896420:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1789776534.896433:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:11139:x1876716432688768:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1789776534.896917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11139:x1876716432688768:12345-192.168.204.27@tcp:35:bash.0 Request processed in 486us (995us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789776534.896928:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00010000:00010000:0.0:1789776534.949624:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776534.979248:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776534.979377:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432689024 00000100:00100000:1.0:1789776534.979400:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432689024 00000100:00100000:1.0:1789776534.979484:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1789776534.979539:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11149:x1876716432689024:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776534.979573:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776534.979613:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab579d expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776534.979779:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789776534.979939:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884d69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab579d expref: 18 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.979958:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:1.0:1789776534.979962:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776534.979968:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab579d expref: 18 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776534.980010:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0a00, rc 0) 00000100:00100000:1.0:1789776534.980097:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:11149:x1876716432689024:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 602us (863us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789776534.980105:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1789776534.984788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776534.984888:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432689280 00000100:00100000:3.0:1789776534.984902:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432689280 00000100:00100000:3.0:1789776534.984979:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1789776534.984994:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:11149:x1876716432689280:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1789776534.985440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:11149:x1876716432689280:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 448us (666us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789776534.985449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1789776535.063246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.063897:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432689408 00000100:00100000:1.0:1789776535.063910:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432689408 00000100:00100000:1.0:1789776535.063992:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1789776535.064005:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:11155:x1876716432689408:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776535.064248:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776535.064277:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57a4 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064600:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064618:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064631:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776535.064687:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789776535.064692:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776535.064715:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064746:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57a4 expref: 20 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064785:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57a4 expref: 19 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.064795:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776535.064798:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776535.064801:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0800, rc 0) 00000100:00100000:1.0:1789776535.064948:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:11155:x1876716432689408:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 943us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776535.064957:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1789776535.075377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.075485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432689664 00000100:00100000:2.0:1789776535.075536:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432689664 00000100:00100000:2.0:1789776535.075609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776535.075621:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:11155:x1876716432689664:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776535.075651:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776535.075679:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884d85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57ab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.075871:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884d8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.075889:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.075909:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776535.075927:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789776535.076104:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884d85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ab expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.076153:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ab expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.076164:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:2.0:1789776535.076168:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776535.076172:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776535.076253:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11155:x1876716432689664:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 633us (891us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789776535.076260:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776535.082053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.082109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.082198:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432689920 00000100:00100000:1.0:1789776535.082209:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432689920 00000100:00100000:1.0:1789776535.082290:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1789776535.082303:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11155:x1876716432689920:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776535.082332:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776535.082356:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884d9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57b2 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.082472:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.082488:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.082543:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776535.082578:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789776535.082685:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884d9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b2 expref: 24 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.082710:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b2 expref: 23 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.082720:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:1.0:1789776535.082723:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789776535.082727:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776535.082791:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:11155:x1876716432689920:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 492us (747us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789776535.082799:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1789776535.082983:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690048 00000100:00100000:3.0:1789776535.082989:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690048 00000100:00100000:3.0:1789776535.083121:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1789776535.083138:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:2414:x1876716432690048:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776535.083149:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776535.083166:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884d8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ab expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.083178:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:3.0:1789776535.083181:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776535.083213:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:2414:x1876716432690048:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 78us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.083219:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:2.0:1789776535.092723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.093031:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690176 00000100:00100000:1.0:1789776535.093042:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690176 00000100:00100000:1.0:1789776535.093222:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:1.0:1789776535.093233:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432690176:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:1.0:1789776535.093289:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.093309:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.093318:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776535.093322:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776535.093326:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.093377:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.093391:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 7 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776535.093407:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1876716449550848:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776535.093530:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc35089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776535.097083:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1876716449550848:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776535.097357:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776535.097540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776535.097680:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690304 00000100:00100000:3.0:1789776535.097687:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690304 00002000:00100000:3.0:1789776535.097727:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8a5cd881f480 x1876716432690304/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:726/0 lens 504/0 e 0 to 0 dl 1789776546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776535.097737:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cd881f480 with x1876716432690304 ext(0->12) 00010000:00010000:3.0:1789776535.097744:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 8 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.097821:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 8 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776535.097829:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5cd881f480 00000100:00100000:3.0:1789776535.097956:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1789776535.097966:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432690304:12345-192.168.204.27@tcp:4:lfs.0 00000001:00100000:0.0:1789776535.101033:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000100:00100000:3.0:1789776535.102669:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432690304:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 4695us (5121us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789776535.102696:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:3.0:1789776535.102709:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8a5cd881f480 x1876716432690304/t4294967300(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:726/0 lens 504/448 e 0 to 0 dl 1789776546 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776535.102719:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cd881f480 with x1876716432690304 ext(0->12) 00010000:00010000:3.0:1789776535.102730:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.102747:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776535.102754:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5cd881f480 00000100:00100000:1.0:1789776535.110049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776535.111326:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690432 00000100:00100000:3.0:1789776535.111336:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690432 00010000:00010000:3.0:1789776535.111455:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776535.111489:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1789776535.111727:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432690432:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776535.111762:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789776535.111788:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789776535.111790:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789776536 00002000:00010000:3.0:1789776535.111792:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789776536 00002000:00010000:3.0:1789776535.111793:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789776536 00002000:00010000:3.0:1789776535.111794:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789776535.111800:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.111816:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.111862:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcbbffea/0xf13b8042cb884d62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5796 expref: 9 pid: 8432 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.111883:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776535.111889:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776535.111906:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.111916:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.112790:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776535.112878:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432690432:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1153us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776535.112887:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00010000:00010000:1.0:1789776535.113013:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113026:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113050:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113058:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113066:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113087:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776535.113092:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113101:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113127:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.113136:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb884daf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776535.113196:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432690176:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 19965us (20483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776535.113203:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1789776535.120755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.120912:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690688 00000100:00100000:1.0:1789776535.120921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690688 00000100:00100000:1.0:1789776535.121010:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1789776535.121019:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:11155:x1876716432690688:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:1.0:1789776535.121079:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b2 expref: 22 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776535.121347:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789776535.121395:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789776535.121711:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1789776535.121747:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.121763:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.121771:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.121803:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.121817:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 26 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776535.121831:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1876716449550976:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776535.122044:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776535.125429:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1876716449550976:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776535.125460:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776535.127194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.127292:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690816 00000100:00100000:0.0:1789776535.127301:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690816 00010000:00010000:0.0:1789776535.127361:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 27 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776535.127405:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:0.0:1789776535.127419:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:2412:x1876716432690816:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776535.127436:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776535.127444:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 27 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127456:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 27 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127518:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884d46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5788 expref: 27 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127535:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:0.0:1789776535.127540:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127549:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127556:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.127586:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776535.127637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:2412:x1876716432690816:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776535.127645:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00010000:00010000:1.0:1789776535.127772:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.127780:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776535.127896:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789776535.128006:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789776535.128112:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449551104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789776535.128158:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776535.128196:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce02d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776535.128389:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449551104 00000100:00100000:0.0:1789776535.128394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449551104 00000100:00100000:0.0:1789776535.128444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789776535.128452:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449551104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789776535.128568:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449551104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776535.128574:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789776535.128700:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776535.128733:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449551104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789776535.128916:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789776535.128961:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449551232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789776535.128990:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776535.129022:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc35089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776535.129156:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449551232 00000100:00100000:0.0:1789776535.129161:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449551232 00000100:00100000:0.0:1789776535.129196:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789776535.129203:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449551232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789776535.129311:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876716449551232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (319us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789776535.129317:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789776535.129436:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff466680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449551232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789776535.129470:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789776535.129526:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129535:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129542:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129548:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776535.129552:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129560:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129573:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:1.0:1789776535.129576:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789776535.129585:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.129591:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884db6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776535.129668:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789776535.129728:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789776535.129739:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356374245506ns, next at 357374243418ns, rc = 0 00000001:00080000:1.0:1789776535.129745:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789776535.129765:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5bc1a87500) 00010000:00010000:1.0:1789776535.129768:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789776535.129774:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884da1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b2 expref: 30 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776535.131813:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:11155:x1876716432690688:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 10776us (11046us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789776535.131826:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000020:00080000:1.0:1789776535.131832:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789776535.137780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.137866:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432690944 00000100:00100000:1.0:1789776535.137876:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432690944 00000100:00100000:1.0:1789776535.137934:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1789776535.137944:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:11155:x1876716432690944:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776535.137968:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776535.137992:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884dbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57b9 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.138066:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b9 expref: 30 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.138099:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b9 expref: 30 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.138118:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776535.138121:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776535.138125:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776535.138192:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11155:x1876716432690944:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 248us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776535.138199:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:3.0:1789776535.142660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.143316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432691200 00000100:00100000:2.0:1789776535.143326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432691200 00000100:00100000:2.0:1789776535.146020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1789776535.146045:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11155:x1876716432691200:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776535.146551:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:11155:x1876716432691200:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 517us (3901us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789776535.146560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1789776535.244937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.245010:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432691456 00000100:00100000:2.0:1789776535.245021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432691456 00000100:00100000:2.0:1789776535.245390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1789776535.245401:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:11165:x1876716432691456:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776535.245427:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776535.245448:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776535.245599:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789776535.246949:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884dc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c0 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.246969:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:2.0:1789776535.246972:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776535.246978:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c0 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.246993:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776535.247071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11165:x1876716432691456:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1672us (2145us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789776535.247079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1789776535.252037:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.254637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432691584 00000100:00100000:0.0:1789776535.254651:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432691584 00000100:00100000:0.0:1789776535.254718:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1789776535.254730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11165:x1876716432691584:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1789776535.255002:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255019:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255032:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255044:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255058:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255138:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255146:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255170:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776535.255222:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255234:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255241:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255248:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255254:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776535.255258:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255265:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255277:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:0.0:1789776535.255280:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776535.255285:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255291:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884dd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255303:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255315:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255321:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255327:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776535.255330:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255336:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255345:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:0.0:1789776535.255347:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776535.255350:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255356:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb884dd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255366:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255371:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255377:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255381:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776535.255390:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255395:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255403:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776535.255405:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776535.255407:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.255413:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb884de0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776535.256609:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11165:x1876716432691584:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 1874us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776535.256622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1789776535.259374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.259441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432691840 00000100:00100000:1.0:1789776535.259452:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432691840 00000100:00100000:1.0:1789776535.259629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1789776535.259640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11165:x1876716432691840:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1789776535.260073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:11165:x1876716432691840:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 433us (706us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789776535.260080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1789776535.294600:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.294720:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432692096 00000100:00100000:2.0:1789776535.294743:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432692096 00000100:00100000:2.0:1789776535.294868:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:2.0:1789776535.294880:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:11168:x1876716432692096:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776535.294904:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776535.294940:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884de7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295023:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295040:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295054:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295077:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295084:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295205:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295213:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295220:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776535.295237:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789776535.295318:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295327:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295334:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295341:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776535.295347:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295355:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295370:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776535.295374:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776535.295378:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295403:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884dee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295419:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295426:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295445:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295450:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776535.295453:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295459:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295467:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776535.295469:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776535.295473:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295479:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884df5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295593:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884de7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295607:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.295614:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776535.295616:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776535.295619:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3e00, rc 0) 00000100:00100000:2.0:1789776535.295684:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11168:x1876716432692096:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 807us (1094us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789776535.295700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1789776535.300829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.301014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432692224 00000100:00100000:2.0:1789776535.301035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432692224 00000100:00100000:2.0:1789776535.301103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1789776535.301115:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11168:x1876716432692224:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1789776535.301183:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301202:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301213:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301250:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301257:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301263:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301269:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776535.301273:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301281:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776535.301308:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776535.301313:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.301319:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776535.301400:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11168:x1876716432692224:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 287us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776535.301408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1789776535.307129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.307207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432692480 00000100:00100000:2.0:1789776535.307217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432692480 00000100:00100000:2.0:1789776535.307266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1789776535.307276:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11168:x1876716432692480:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776535.307563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:11168:x1876716432692480:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 288us (448us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789776535.307572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1789776535.583899:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.584179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432692736 00000100:00100000:0.0:1789776535.584189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432692736 00000100:00100000:0.0:1789776535.584257:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1789776535.584276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:11199:x1876716432692736:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1789776535.584299:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776535.584319:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884e11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.584422:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884e18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.584436:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.584456:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776535.584467:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789776535.584634:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb884e11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ce expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.584653:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884e18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ce expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.584663:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776535.584666:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776535.584669:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9a00, rc 0) 00000100:00100000:0.0:1789776535.584739:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11199:x1876716432692736:12345-192.168.204.27@tcp:101:cat.0 Request processed in 472us (850us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789776535.584746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1789776535.589924:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.589972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776535.590055:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432693120 00000100:00100000:3.0:1789776535.590065:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432693120 00000100:00100000:3.0:1789776535.590133:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1789776535.590143:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:2414:x1876716432693120:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776535.590175:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776535.590202:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb884e18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ce expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776535.590225:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:3.0:1789776535.590230:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776535.590402:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:2414:x1876716432693120:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 260us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.590410:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1789776535.590479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432692992 00000100:00100000:2.0:1789776535.590545:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432692992 00000100:00100000:2.0:1789776535.590576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1789776535.590583:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:11199:x1876716432692992:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:2.0:1789776535.590792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11199:x1876716432692992:12345-192.168.204.27@tcp:35:cat.0 Request processed in 208us (877us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789776535.590799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1789776535.678945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.679577:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432693376 00000100:00100000:2.0:1789776535.679587:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432693376 00000100:00100000:2.0:1789776535.679654:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1789776535.679664:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11205:x1876716432693376:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1789776535.679713:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776535.679716:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789776535.679744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884d7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57a4 expref: 38 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679764:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776535.679769:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776535.679782:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679905:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679918:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679926:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679957:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.679970:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 38 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776535.679983:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449551360:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776535.680094:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776535.685160:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449551360:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776535.685205:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776535.687618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.688352:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432693504 00000100:00100000:0.0:1789776535.688363:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432693504 00010000:00010000:0.0:1789776535.688409:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 39 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776535.688454:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1789776535.688464:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:2411:x1876716432693504:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776535.688479:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776535.688540:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 39 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688554:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 39 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688579:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884dfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57c7 expref: 39 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688597:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776535.688602:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688613:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688621:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.688648:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776535.688727:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:2411:x1876716432693504:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 264us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776535.688736:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00010000:00010000:2.0:1789776535.688882:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.688891:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776535.688912:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789776535.689081:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.689099:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.689106:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776535.689109:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776535.689112:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776535.689155:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11205:x1876716432693376:12345-192.168.204.27@tcp:101:dd.0 Request processed in 9492us (10220us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789776535.689163:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1789776535.694051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.694392:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432693632 00000100:00100000:1.0:1789776535.694404:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432693632 00000100:00100000:1.0:1789776535.694473:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1789776535.694484:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11205:x1876716432693632:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:1.0:1789776535.694539:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776535.694564:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884e3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57dc expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694604:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694635:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694648:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694781:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 40 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694799:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 39 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.694809:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776535.694812:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776535.694816:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0000, rc 0) 00000100:00100000:1.0:1789776535.694899:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:11205:x1876716432693632:12345-192.168.204.27@tcp:101:dd.0 Request processed in 417us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776535.694907:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:0.0:1789776535.703277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776535.703412:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432693888 00000100:00100000:1.0:1789776535.703421:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432693888 00000100:00100000:1.0:1789776535.703505:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:1.0:1789776535.703518:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:11205:x1876716432693888:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:1.0:1789776535.703740:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.703760:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.703792:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776535.703854:0:10345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1789776535.703880:0:10345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005322e148 reply state 00000000d3181f92 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.703893:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776535.703901:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776535.703904:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776535.703908:0:10345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776535.704023:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:11205:x1876716432693888:12345-192.168.204.27@tcp:36:dd.0 Request processed in 507us (753us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789776535.704030:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:1.0:1789776535.704036:0:10345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776535.970655:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776535.978605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776535.979322:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432694016 00000100:00100000:2.0:1789776535.979336:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432694016 00000100:00100000:2.0:1789776535.979458:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1789776535.979470:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:11219:x1876716432694016:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1789776535.979538:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776535.979564:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57e3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979691:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979704:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979715:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979722:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979729:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979808:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979818:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979828:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979884:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.979913:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 43 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776535.979930:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449551488:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776535.980054:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776535.984107:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776535.984237:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432694272 00000100:00100000:3.0:1789776535.984320:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432694272 00000100:00100000:3.0:1789776535.984608:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1789776535.984622:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:6178:x1876716432694272:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789776535.985059:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:6178:x1876716432694272:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 439us (960us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789776535.985067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1789776535.986732:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449551488:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776535.986772:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776535.989407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776535.989612:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432694400 00000100:00100000:0.0:1789776535.989627:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432694400 00010000:00010000:0.0:1789776535.989681:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 45 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776535.989758:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1789776535.989770:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:2411:x1876716432694400:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776535.989791:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776535.989799:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 45 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.989814:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 45 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.989853:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb884e2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57d5 expref: 45 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.989874:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776535.989881:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.989891:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.989899:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776535.990942:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776535.991034:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:2411:x1876716432694400:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1261us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776535.991047:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00010000:00010000:2.0:1789776535.994419:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994439:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776535.994615:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789776535.994621:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776535.994680:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994698:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994710:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994718:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994747:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994754:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776535.994759:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994768:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994788:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776535.994791:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776535.994796:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994803:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994822:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994827:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994845:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994850:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776535.994853:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994869:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994878:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776535.994880:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776535.994883:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994891:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994940:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57e3 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994957:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57e3 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776535.994965:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776535.994968:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776535.994971:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3e00, rc 0) 00000100:00100000:2.0:1789776535.995061:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:11219:x1876716432694016:12345-192.168.204.27@tcp:101:stat.0 Request processed in 15592us (16468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776535.995072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1789776536.069443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776536.069610:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432694656 00000100:00100000:1.0:1789776536.069622:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432694656 00000100:00100000:1.0:1789776536.069714:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1789776536.069727:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:11225:x1876716432694656:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:1.0:1789776536.069805:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1789776536.069951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776536.069998:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb884e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57e3 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.070145:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776536.070152:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776536.070405:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.070423:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.070435:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776536.070490:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789776536.070650:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095731670 reply state 00000000d8feaad2 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.070664:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.070671:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776536.070674:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776536.070677:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776536.070816:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:11225:x1876716432694656:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 1092us (1388us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789776536.070825:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000020:00080000:1.0:1789776536.070847:0:13443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789776536.230661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.231605:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432694784 00000100:00100000:2.0:1789776536.231621:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432694784 00000100:00100000:2.0:1789776536.231713:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1789776536.231725:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:11239:x1876716432694784:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1789776536.231778:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776536.231806:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57ea expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231904:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231922:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231935:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231945:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231952:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.231958:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232047:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232056:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232062:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.232118:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789776536.232129:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776536.232160:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232177:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232187:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232195:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232202:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232209:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776536.232214:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232223:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232237:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776536.232241:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776536.232246:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232253:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884e7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232270:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232290:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232297:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232302:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776536.232305:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232312:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232320:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776536.232322:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776536.232325:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232331:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884e81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232362:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 47 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232377:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 46 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.232386:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.232388:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776536.232397:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3200, rc 0) 00000100:00100000:2.0:1789776536.232980:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+46:11239:x1876716432694784:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1254us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776536.232990:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1789776536.336241:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.336371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432695040 00000100:00100000:2.0:1789776536.336390:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432695040 00000100:00100000:2.0:1789776536.336487:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1789776536.336548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+46:11249:x1876716432695040:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776536.336579:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776536.336606:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57f1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.336744:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789776536.336903:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f1 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.336919:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:2.0:1789776536.336922:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776536.336928:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f1 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.336945:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776536.337032:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:11249:x1876716432695040:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 489us (799us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789776536.337041:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:3.0:1789776536.343787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776536.343920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432695296 00000100:00100000:0.0:1789776536.343936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432695296 00000100:00100000:0.0:1789776536.344019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1789776536.344030:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:11249:x1876716432695296:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776536.344284:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:11249:x1876716432695296:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 255us (511us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789776536.344292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1789776536.413478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.413919:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432695552 00000100:00100000:2.0:1789776536.413933:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432695552 00000100:00100000:2.0:1789776536.414016:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1789776536.414049:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:11255:x1876716432695552:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776536.414086:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776536.414116:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57f8 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.414270:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.414291:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 49 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.414313:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.414359:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 49 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.414375:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 49 pid: 10345 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776536.414390:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449551616:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776536.414549:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc36679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776536.418775:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449551616:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776536.418821:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776536.421717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776536.422337:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432695680 00000100:00100000:0.0:1789776536.422351:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432695680 00010000:00010000:0.0:1789776536.422410:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 50 pid: 10345 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776536.422458:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1789776536.422470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:2412:x1876716432695680:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776536.422489:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776536.422523:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 50 pid: 10345 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422540:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 50 pid: 10345 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422568:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884e88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ea expref: 50 pid: 10345 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422590:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776536.422596:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422632:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422641:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.422688:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776536.422771:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:2412:x1876716432695680:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 302us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776536.422780:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00010000:00010000:2.0:1789776536.423106:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.423128:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.423153:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789776536.423331:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884e9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 50 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.423349:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 49 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.423357:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.423360:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776536.423362:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776536.423398:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:11255:x1876716432695552:12345-192.168.204.27@tcp:101:bash.0 Request processed in 9354us (9936us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789776536.423406:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1789776536.428782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.429163:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432695936 00000100:00100000:2.0:1789776536.429176:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432695936 00000100:00100000:2.0:1789776536.429304:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1789776536.429318:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:11255:x1876716432695936:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:2.0:1789776536.429692:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.429715:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.429729:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776536.429802:0:10345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789776536.429846:0:10345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b704f57a reply state 000000009307eefd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.429862:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.429871:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.429873:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776536.429877:0:10345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776536.430021:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:11255:x1876716432695936:12345-192.168.204.27@tcp:36:bash.0 Request processed in 706us (1254us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789776536.430030:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000020:00080000:2.0:1789776536.430035:0:10345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789776536.444976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776536.445142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432696064 00000100:00100000:3.0:1789776536.445157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432696064 00000100:00100000:3.0:1789776536.445239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776536.445254:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:11255:x1876716432696064:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776536.445308:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776536.445337:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884eb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab57ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.445462:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.445479:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 53 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.445489:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.445587:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 53 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.445603:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 53 pid: 13443 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776536.445620:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff481f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449551744:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776536.445720:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776536.448566:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff481f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449551744:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776536.448609:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776536.449439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776536.449744:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432696192 00000100:00100000:3.0:1789776536.449757:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432696192 00010000:00010000:3.0:1789776536.449809:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 54 pid: 13443 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776536.449924:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1789776536.449948:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:2412:x1876716432696192:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776536.449988:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776536.450008:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 54 pid: 13443 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450025:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 54 pid: 13443 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450052:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884ea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57f8 expref: 54 pid: 13443 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450073:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:3.0:1789776536.450080:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450092:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450101:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.450135:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776536.450208:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:2412:x1876716432696192:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 273us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776536.450217:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00010000:00010000:2.0:1789776536.450527:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.450537:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.450609:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789776536.450615:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776536.450641:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.450683:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884eb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ff expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.450714:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ff expref: 52 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.450722:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.450725:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776536.450728:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:2.0:1789776536.450763:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:11255:x1876716432696064:12345-192.168.204.27@tcp:101:bash.0 Request processed in 5514us (5806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776536.450771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776536.457805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776536.458318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432696448 00000100:00100000:0.0:1789776536.458331:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432696448 00000100:00100000:0.0:1789776536.458406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1789776536.458419:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:11255:x1876716432696448:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1789776536.458756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11255:x1876716432696448:12345-192.168.204.27@tcp:35:bash.0 Request processed in 338us (964us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789776536.458765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1789776536.558194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.558560:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432696704 00000100:00100000:2.0:1789776536.558575:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432696704 00000100:00100000:2.0:1789776536.558695:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:2.0:1789776536.558710:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11265:x1876716432696704:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776536.558744:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776536.558771:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5806 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.558983:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789776536.559302:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884ec7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5806 expref: 55 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.559321:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:2.0:1789776536.559324:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776536.559331:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5806 expref: 55 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.559370:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776536.559461:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11265:x1876716432696704:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 754us (1281us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789776536.559470:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:1.0:1789776536.562738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776536.562923:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432696832 00000100:00100000:3.0:1789776536.562936:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432696832 00000100:00100000:3.0:1789776536.563021:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:3.0:1789776536.563046:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11265:x1876716432696832:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1789776536.563160:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563181:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563194:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563208:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563215:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563222:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563329:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563339:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563346:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776536.563407:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563424:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563442:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563449:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563456:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776536.563461:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563470:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563486:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776536.563489:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776536.563535:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563542:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884ed5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563558:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563563:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563569:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563574:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776536.563583:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563590:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563599:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:3.0:1789776536.563601:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776536.563604:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563611:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563620:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563626:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563631:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563636:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776536.563638:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563644:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563650:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:3.0:1789776536.563652:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776536.563659:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.563665:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776536.563752:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11265:x1876716432696832:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 709us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776536.563760:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1789776536.567800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776536.567982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432697088 00000100:00100000:0.0:1789776536.568174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432697088 00000100:00100000:0.0:1789776536.568282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1789776536.568295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11265:x1876716432697088:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776536.568631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:11265:x1876716432697088:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 337us (846us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789776536.568640:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1789776536.602791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.606615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432697344 00000100:00100000:2.0:1789776536.606640:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432697344 00000100:00100000:2.0:1789776536.606835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:2.0:1789776536.606850:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:11268:x1876716432697344:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776536.606893:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776536.606922:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884eea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab580d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607429:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607452:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607468:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607484:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607490:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607539:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607722:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.607729:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776536.607741:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789776536.607864:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611261:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611271:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611278:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776536.611283:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611296:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611320:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776536.611323:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776536.611330:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb884ef1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611388:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611394:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611399:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611405:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776536.611408:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611414:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611423:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776536.611425:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776536.611428:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611435:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884ef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611567:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884eea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab580d expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611587:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab580d expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.611602:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.611605:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776536.611608:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776536.611710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11268:x1876716432697344:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 4862us (8931us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789776536.611720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1789776536.611966:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449551872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776536.612004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449552000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776536.612066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776536.612136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776536.612173:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449551872 00000100:00100000:0.0:1789776536.612184:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449551872 00000100:00100000:3.0:1789776536.612211:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449552000 00000100:00100000:3.0:1789776536.612220:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449552000 00000100:00100000:0.0:1789776536.612243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789776536.612256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449551872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776536.612296:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1789776536.612353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449551872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776536.613119:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789776536.613138:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449552000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776536.613175:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776536.614420:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449552000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 782us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776536.615523:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449552000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776536.615649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.615709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449551872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776536.615736:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432697472 00000100:00100000:2.0:1789776536.615743:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432697472 00000100:00100000:2.0:1789776536.615797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:2.0:1789776536.615805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11268:x1876716432697472:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1789776536.615906:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.615925:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.615938:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.615982:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.615990:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.616015:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.616156:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776536.616162:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.616171:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.616187:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776536.616191:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776536.616196:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776536.616203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb884f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776536.616284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11268:x1876716432697472:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 478us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776536.616291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:0.0:1789776536.619719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789776536.620117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.620236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776536.620317:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432697856 00000100:00100000:2.0:1789776536.620331:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432697856 00000100:00100000:2.0:1789776536.620397:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776536.620410:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11268:x1876716432697856:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776536.621342:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432697600 00000100:00100000:0.0:1789776536.621353:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432697600 00000100:00100000:0.0:1789776536.621414:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1789776536.621425:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:2411:x1876716432697600:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776536.621440:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776536.621475:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb884eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab580d expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776536.621618:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:0.0:1789776536.621770:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776536.621778:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776536.622604:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:2411:x1876716432697600:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1173us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776536.622616:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1789776536.624616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11268:x1876716432697856:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 4194us (4364us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789776536.624632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776536.781465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776536.782479:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432698112 00000100:00100000:1.0:1789776536.782525:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432698112 00000100:00100000:1.0:1789776536.782610:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:1.0:1789776536.782623:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:11286:x1876716432698112:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:1.0:1789776536.782655:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776536.782683:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5814 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.782840:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f1b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.782858:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.782874:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776536.782888:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789776536.783120:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5814 expref: 60 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.783143:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5814 expref: 59 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.783152:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776536.783154:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789776536.783158:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0800, rc 0) 00000100:00100000:1.0:1789776536.783256:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11286:x1876716432698112:12345-192.168.204.27@tcp:101:cat.0 Request processed in 636us (1807us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789776536.783283:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:2.0:1789776536.824851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776536.824966:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432698240 00000100:00100000:3.0:1789776536.824980:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432698240 00000100:00100000:3.0:1789776536.825070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1789776536.825084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11287:x1876716432698240:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776536.825117:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776536.825145:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab581b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.825486:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.825691:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.825706:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776536.825772:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789776536.825777:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776536.825802:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.826102:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab581b expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.826128:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab581b expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.826139:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776536.826142:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776536.826146:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c000, rc 0) 00000100:00100000:3.0:1789776536.827545:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11287:x1876716432698240:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 2450us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776536.827560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1789776536.832893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776536.833089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432698624 00000100:00100000:1.0:1789776536.833103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432698624 00000100:00100000:1.0:1789776536.833174:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1789776536.833187:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11287:x1876716432698624:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776536.836179:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11287:x1876716432698624:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 2980us (3364us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789776536.836196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1789776536.839970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776536.840770:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432698752 00000100:00100000:0.0:1789776536.840785:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432698752 00000100:00100000:0.0:1789776536.840896:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1789776536.840927:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11287:x1876716432698752:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:0.0:1789776536.840948:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789776536.840997:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57ff expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.841025:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5814 expref: 60 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.841039:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57b9 expref: 59 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776536.841049:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:0.0:1789776536.841056:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776536.841236:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11287:x1876716432698752:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 312us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776536.841245:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1789776536.845338:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776536.845966:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432698880 00000100:00100000:3.0:1789776536.846075:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432698880 00000100:00100000:3.0:1789776536.846252:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:3.0:1789776536.846265:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11287:x1876716432698880:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:3.0:1789776536.846439:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.846462:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776536.846475:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776536.846923:0:10345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776536.848763:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789776536.849354:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789776536.850109:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11287:x1876716432698880:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 3837us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776536.850124:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1789776536.870195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776536.871809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699008 00000100:00100000:1.0:1789776536.871840:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699008 00000100:00100000:1.0:1789776536.871998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:1.0:1789776536.872010:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11289:x1876716432699008:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776536.872032:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776536.872056:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872136:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872152:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872163:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872174:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872180:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872186:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872289:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872299:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872307:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776536.872351:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789776536.872356:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776536.872375:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872386:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872395:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872401:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872408:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872415:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776536.872419:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872427:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872447:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776536.872450:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776536.872455:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872461:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872476:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872483:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872488:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872537:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776536.872540:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872552:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872572:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:1.0:1789776536.872574:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776536.872577:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872660:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872700:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872713:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776536.872722:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776536.872725:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776536.872727:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776536.872785:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11289:x1876716432699008:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 778us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776536.872792:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00010000:00010000:0.0:1789776536.994844:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789776537.634714:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776537.634721:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776537.634764:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789776537.634774:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776537.634941:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff483800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449552128:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789776537.635039:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc93299c0 going to sleep for 11 seconds 00000040:00080000:0.0:1789776537.637663:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789776537.641456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.641540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699136 00000100:00100000:1.0:1789776537.641550:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699136 00000100:00100000:1.0:1789776537.641623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:1.0:1789776537.641645:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432699136:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000100:00100000:0.0:1789776537.641662:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff483800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449552128:192.168.204.27@tcp:107:hsm_cdtr.0 00000004:00000080:1.0:1789776537.641679:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776537.641814:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11301:x1876716432699136:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 171us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.641822:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1789776537.656391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000040:00080000:1.0:1789776537.658581:0:14204:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776537.658590:0:14204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776537.658627:0:14204:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789776537.658634:0:14204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776537.660572:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699264 00000100:00100000:1.0:1789776537.660782:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699264 00000100:00100000:1.0:1789776537.660876:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:1.0:1789776537.660891:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11301:x1876716432699264:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789776537.660964:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.660984:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661108:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661329:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661340:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661349:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661392:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661409:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661417:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776537.661466:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789776537.661471:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776537.661487:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661529:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661536:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661543:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661548:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776537.661552:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661560:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661572:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:1.0:1789776537.661575:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776537.661579:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661585:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb884f5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661603:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661609:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661614:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661625:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776537.661628:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661634:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661642:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8a5cc3edee00) 00010000:00010000:1.0:1789776537.661645:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776537.661647:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661654:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb884f61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661667:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661674:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661680:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661686:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776537.661689:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661695:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661712:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776537.661714:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776537.661717:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.661722:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb884f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.661820:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11301:x1876716432699264:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 934us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.661828:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:1.0:1789776537.667115:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.667261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699520 00000100:00100000:3.0:1789776537.667272:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699520 00000100:00100000:3.0:1789776537.667333:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:3.0:1789776537.667342:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11301:x1876716432699520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776537.667375:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776537.667395:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5829 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667525:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667541:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667553:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776537.667566:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789776537.667643:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667651:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667657:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667663:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.667668:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667675:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667687:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:3.0:1789776537.667697:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776537.667702:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667708:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884f76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667750:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f6f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5829 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667762:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:3.0:1789776537.667764:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776537.667768:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5829 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.667777:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ca00, rc 0) 00000100:00100000:3.0:1789776537.667915:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432699520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 572us (807us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1789776537.667923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:1.0:1789776537.670465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.670560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699648 00000100:00100000:3.0:1789776537.670569:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699648 00000100:00100000:3.0:1789776537.670627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1789776537.670638:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432699648:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776537.670674:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789776537.670781:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432699648:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.670789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1789776537.675202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.675287:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432699904 00000100:00100000:1.0:1789776537.675298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432699904 00000100:00100000:1.0:1789776537.675362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:1.0:1789776537.675373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432699904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776537.675394:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776537.675397:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776537.675425:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb884f30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab581b expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.675444:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776537.675449:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776537.675463:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5830 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776537.675890:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789776537.676048:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.676063:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.676073:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.676130:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb884f84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5830 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.676145:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5830 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.676153:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5cc3ede800) 00010000:00010000:1.0:1789776537.676155:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776537.676158:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:1.0:1789776537.676218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11301:x1876716432699904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 847us (1027us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789776537.676228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:1.0:1789776537.686370:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.686524:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700160 00000100:00100000:3.0:1789776537.686535:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700160 00000100:00100000:3.0:1789776537.686592:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:3.0:1789776537.686604:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11301:x1876716432700160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789776537.686665:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776537.686880:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5830 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.686898:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5cc3ede800) 00010000:00010000:3.0:1789776537.686908:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776537.686931:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.686947:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.686957:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687089:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687099:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687107:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687157:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687177:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687185:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687192:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.687196:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687203:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687213:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776537.687216:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776537.687219:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687225:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884f99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687236:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687241:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687246:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687250:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.687259:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687265:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687274:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x31abab13 (ffff8a5bc33d2700) 00010000:00010000:3.0:1789776537.687276:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776537.687279:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.687285:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fa0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x31abab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.687374:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432700160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 771us (1014us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776537.688388:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:1.0:1789776537.697399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.697522:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700288 00000100:00100000:3.0:1789776537.697532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700288 00000100:00100000:2.0:1789776537.697620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:2.0:1789776537.697856:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11301:x1876716432700288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776537.697878:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776537.697904:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884fa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.697946:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.697960:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.697973:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.698120:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb884fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.698144:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.698161:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:2.0:1789776537.698165:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776537.698169:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776537.699100:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11301:x1876716432700288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1464us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776537.699134:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:1.0:1789776537.704944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776537.705378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700544 00000100:00100000:0.0:1789776537.705388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700544 00000100:00100000:0.0:1789776537.705480:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:0.0:1789776537.705516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11301:x1876716432700544:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789776537.705623:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.705643:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.705663:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776537.705958:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789776537.706046:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358950552241ns, next at 359950549414ns, rc = 0 00000004:00010000:0.0:1789776537.706098:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000189adf17 reply state 000000006df11569 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.706112:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.706120:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:0.0:1789776537.706123:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789776537.706127:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776537.706239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11301:x1876716432700544:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 748us (1303us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789776537.706247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:2.0:1789776537.719275:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.719373:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700672 00000100:00100000:3.0:1789776537.719384:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700672 00000100:00100000:3.0:1789776537.719452:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:3.0:1789776537.719463:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11301:x1876716432700672:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776537.719510:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776537.722878:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab583e expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.723116:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 64 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.723149:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 64 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.723172:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:3.0:1789776537.723175:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776537.723179:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342da00, rc 0) 00000100:00100000:3.0:1789776537.727195:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:11301:x1876716432700672:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 7718us (7915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.727210:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1789776537.742391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776537.742490:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700800 00000100:00100000:0.0:1789776537.742537:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700800 00000100:00100000:0.0:1789776537.742584:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:0.0:1789776537.742592:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1876716432700800:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789776537.742629:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:0.0:1789776537.742660:0:8433:0:(genops.c:1385:class_connect()) connect: client 1c6b552f-1300-40e3-a848-4343cb28ffe2, cookie 0xf13b8042cb884fc3 00002000:00100000:0.0:1789776537.742673:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1c6b552f-1300-40e3-a848-4343cb28ffe2/ffff8a5cd884e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789776537.742689:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789776537.744471:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789776537.744606:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5cd884c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776537.744716:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2410:x1876716432700800:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 Request processed in 2121us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776537.744736:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:1.0:1789776537.753573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.753672:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432700928 00000100:00100000:3.0:1789776537.753682:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432700928 00000100:00100000:3.0:1789776537.753746:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1789776537.753757:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:0:x1876716432700928:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789776537.753931:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789776537.758403:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1789776537.758422:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000100:00100000:0.0:1789776537.759737:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:0:x1876716432700928:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 5974us (6166us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789776537.759749:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1789776537.765408:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.767256:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432701184 00000100:00100000:2.0:1789776537.767270:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432701184 00000100:00100000:2.0:1789776537.767334:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1789776537.767344:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:11301:x1876716432701184:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776537.767581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11301:x1876716432701184:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 238us (2180us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789776537.767590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1789776537.770472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.770660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432701440 00000100:00100000:2.0:1789776537.770671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432701440 00000100:00100000:2.0:1789776537.770732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:2.0:1789776537.770743:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11301:x1876716432701440:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776537.770931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11301:x1876716432701440:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 189us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776537.770939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:1.0:1789776537.774300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.774369:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432701568 00000100:00100000:3.0:1789776537.774380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432701568 00000100:00100000:3.0:1789776537.774444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1789776537.774455:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11301:x1876716432701568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776537.774480:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776537.774528:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884fca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5845 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774631:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774647:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774661:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776537.774706:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776537.774725:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb884fca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5845 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774767:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5845 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.774776:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:3.0:1789776537.774779:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776537.774783:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:3.0:1789776537.774925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11301:x1876716432701568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 470us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.774933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1789776537.778206:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776537.778285:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432701696 00000100:00100000:0.0:1789776537.778295:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432701696 00000100:00100000:0.0:1789776537.778357:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1789776537.778368:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432701696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776537.778386:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776537.778406:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab584c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776537.778433:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd29a, blocks: 0x0 00010000:00010000:0.0:1789776537.778454:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789776537.778460:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776537.778469:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.778489:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.778532:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9600, rc 0) 00000100:00100000:0.0:1789776537.778585:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432701696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 219us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776537.778599:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1789776537.781556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.781650:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432701952 00000100:00100000:1.0:1789776537.781659:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432701952 00000100:00100000:1.0:1789776537.781718:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:1.0:1789776537.781729:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11301:x1876716432701952:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789776537.781849:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11301:x1876716432701952:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.781856:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:3.0:1789776537.784617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.784710:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702080 00000100:00100000:1.0:1789776537.784720:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702080 00000100:00100000:1.0:1789776537.784776:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1789776537.784787:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:11301:x1876716432702080:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776537.784819:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776537.784838:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5853 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.784869:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.784878:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776537.784883:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776537.784888:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.784920:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.784945:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 7 pid: 8432 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.784959:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1876716449552256:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776537.785434:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776537.788381:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.788423:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702208 00000100:00100000:1.0:1789776537.788432:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702208 00010000:00010000:1.0:1789776537.788476:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 8 pid: 8432 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.788541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1789776537.788553:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432702208:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776537.788570:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776537.788593:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 8 pid: 8432 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.788609:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 8 pid: 8432 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.788640:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776537.788646:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776537.788656:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.788681:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.788721:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.788737:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1876716449552384:192.168.204.27@tcp:105: 00000100:00100000:1.0:1789776537.788834:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789776537.789668:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eaff74d/0xf13b8042cb884fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab584c expref: 8 pid: 8432 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.789688:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1876716449552256:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776537.789719:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.789729:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fe00, rc 0) 00000100:00100000:3.0:1789776537.789782:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11301:x1876716432702080:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 4998us (5174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.789790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:3.0:1789776537.792866:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1876716449552384:192.168.204.27@tcp:105: 00010000:00010000:3.0:1789776537.792891:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776537.792954:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432702208:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 4403us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.792973:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1789776537.796903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.797104:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702336 00000100:00100000:3.0:1789776537.797114:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702336 00002000:00100000:3.0:1789776537.797164:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a5cff490a80 x1876716432702336/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:728/0 lens 504/0 e 0 to 0 dl 1789776548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776537.797175:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff490a80 with x1876716432702336 ext(0->8) 00002000:00010000:3.0:1789776537.797181:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff490a80 00000100:00100000:3.0:1789776537.797214:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1789776537.797224:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432702336:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789776537.800593:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432702336:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 3356us (3689us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789776537.800681:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:3.0:1789776537.800697:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a5cff490a80 x1876716432702336/t4294967303(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:728/0 lens 504/448 e 0 to 0 dl 1789776548 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776537.800708:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff490a80 with x1876716432702336 ext(0->8) 00002000:00010000:3.0:1789776537.800716:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff490a80 00000100:00100000:1.0:1789776537.805993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.806992:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702464 00000100:00100000:3.0:1789776537.807004:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702464 00000100:00100000:3.0:1789776537.807082:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:3.0:1789776537.807095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11301:x1876716432702464:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789776537.813560:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789776537.813583:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789776537.813682:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789776537.813703:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5ce02d9180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789776537.813709:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc3665900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5ce02d9e40 00000020:00080000:3.0:1789776537.813713:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cf50fab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cca398200 00010000:00010000:2.0:1789776537.813717:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813730:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813738:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813745:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2600 already unused, calling callback (ffffffffc180b4f0) 00000100:00100000:1.0:1789776537.813750:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449552512:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789776537.813762:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813771:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813791:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a5bc1a87900) 00010000:00010000:2.0:1789776537.813805:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.813811:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813819:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb884cf9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813841:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.813850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776537.813851:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813861:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813867:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.813870:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813876:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813884:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776537.813887:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.813903:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813910:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb884d00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813972:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813978:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813984:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813988:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.813991:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.813997:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814005:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776537.814008:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.814010:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814016:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb884d3f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814030:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814047:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814053:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814057:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.814060:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814076:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776537.814078:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.814081:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814087:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb884e49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814098:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814105:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814111:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814116:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.814124:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814131:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814139:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776537.814142:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.814145:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814151:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb884e6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814163:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814168:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814173:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814178:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.814181:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814186:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814194:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776537.814196:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776537.814206:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814212:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884eb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814224:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814231:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814237:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814242:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776537.814245:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814251:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814258:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:2.0:1789776537.814260:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789776537.814264:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.814269:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb884fb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776537.814551:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449552640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789776537.815111:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11301:x1876716432702464:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 8014us (9125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776537.815123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:1.0:1789776537.815391:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449552512 00000100:00100000:1.0:1789776537.815399:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449552512 00000100:00100000:1.0:1789776537.815449:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776537.815459:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449552512:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789776537.815769:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789776537.815970:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00002000:00010000:1.0:1789776537.816000:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789776537.816005:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789776538 00002000:00010000:1.0:1789776537.816007:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789776537.816010:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789776538 -> 1789776538 00002000:00010000:1.0:1789776537.816018:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789776537.816077:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449552512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 620us (2229us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789776537.816085:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789776537.816204:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789776537.818109:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cff491180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789776537.818126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449552512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776537.818575:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776537.818695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776537.818750:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702592 00000100:00100000:0.0:1789776537.818757:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702592 00000100:00100000:0.0:1789776537.818874:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449552640 00000100:00100000:0.0:1789776537.818879:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449552640 00000100:00100000:0.0:1789776537.822714:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:0.0:1789776537.822743:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432702592:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1789776537.822846:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776537.822911:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776537.822923:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449552640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789776537.822945:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789776537.822995:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aadd298, atime: 0x6aadd298, ctime: 0x6aadd298, blocks: 0x8 00010000:00010000:3.0:1789776537.823011:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.823030:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789776537.823036:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776537.823044:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.823062:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.823074:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.823083:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.823110:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789776537.823295:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1876716449552640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 374us (4600us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789776537.823304:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1789776537.825544:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776537.825563:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.825580:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776537.825585:0:7925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.825598:0:7925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.825621:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.825629:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006538c72d/0xf13b8042cb884fe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776537.825666:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776537.825668:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776537.825670:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789776537.825724:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cd8824a80/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789776537.825734:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449552640:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789776537.827753:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789776537.827773:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789776537.827958:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432702592:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 5223us (9379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776537.827971:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1789776537.832733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.832839:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702848 00000100:00100000:2.0:1789776537.832849:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702848 00000100:00100000:2.0:1789776537.832911:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:2.0:1789776537.832931:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11301:x1876716432702848:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776537.832986:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776537.833015:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb884fd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5845 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.833032:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:2.0:1789776537.833037:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776537.833069:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.833083:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.833094:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776537.833222:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036e732e4 reply state 00000000b277729c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.833235:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.833241:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:2.0:1789776537.833243:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776537.833246:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776537.833350:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:11301:x1876716432702848:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 422us (625us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789776537.833368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:1.0:1789776537.844865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.844954:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432702976 00000100:00100000:2.0:1789776537.844966:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432702976 00000100:00100000:2.0:1789776537.845063:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1789776537.845078:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432702976:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789776537.845258:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789776537.845262:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789776538 -> 1789776537 00002000:00010000:2.0:1789776537.845265:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789776536 00002000:00010000:2.0:1789776537.845267:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789776538 -> 1789776537 00002000:00010000:2.0:1789776537.845269:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789776537.845344:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432702976:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 269us (489us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789776537.845352:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1789776537.847910:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.848435:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432703232 00000100:00100000:1.0:1789776537.848446:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432703232 00000100:00100000:1.0:1789776537.848519:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:1.0:1789776537.848530:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:11301:x1876716432703232:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789776537.848599:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.848617:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.848627:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.848663:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.848675:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 15 pid: 6517 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.848690:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10345:1876716449552768:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776537.848776:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776537.852473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.853283:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432703360 00000100:00100000:2.0:1789776537.853296:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432703360 00010000:00010000:2.0:1789776537.853339:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 16 pid: 6517 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.853389:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1789776537.853400:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:2412:x1876716432703360:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776537.853416:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776537.853422:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 16 pid: 6517 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.853436:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 16 pid: 6517 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.853467:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:2.0:1789776537.853473:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.853483:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.853512:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.853535:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776537.853589:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:2412:x1876716432703360:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 191us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776537.853596:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00010000:00010000:3.0:1789776537.860461:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb884fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5837 expref: 15 pid: 6517 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.860487:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10345:1876716449552768:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776537.860534:0:10345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860554:0:10345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860561:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860603:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860612:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860620:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860627:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.860632:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860641:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860660:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:3.0:1789776537.860663:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789776537.860670:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.860676:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb884ff4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.860762:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11301:x1876716432703232:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 12233us (12860us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789776537.860780:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:2.0:1789776537.863484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.863909:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432703488 00000100:00100000:3.0:1789776537.863919:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432703488 00000100:00100000:3.0:1789776537.863989:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1789776537.864000:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432703488:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789776537.864043:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.864066:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.864076:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776537.864080:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776537.864085:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.864121:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.864136:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 7 pid: 8434 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.864153:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449552896:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776537.864232:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776537.867132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776537.867201:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449552896:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776537.867231:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.867849:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432703616 00000100:00100000:1.0:1789776537.867858:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432703616 00010000:00010000:1.0:1789776537.867898:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.867941:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1789776537.867951:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432703616:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776537.867981:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776537.868005:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.868020:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.868043:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065125d92/0xf13b8042cb884fdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5853 expref: 8 pid: 8434 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.868059:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776537.868063:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776537.868069:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.868088:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.868113:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776537.868173:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432703616:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 222us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.868180:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00010000:00010000:1.0:1789776537.869421:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869437:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869466:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869475:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869484:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869513:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776537.869519:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869528:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869544:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.869552:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005413ca6d/0xf13b8042cb884ffb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.869636:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432703488:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 5635us (6161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.869645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1789776537.875873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.875970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432703872 00000100:00100000:2.0:1789776537.875981:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432703872 00000100:00100000:2.0:1789776537.876052:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:2.0:1789776537.876063:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11301:x1876716432703872:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789776537.876378:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.876395:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 14 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.876405:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.876454:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 14 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.876468:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 14 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.876481:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553024:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776537.876574:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776537.879332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.879365:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704000 00000100:00100000:2.0:1789776537.879374:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704000 00010000:00010000:2.0:1789776537.879418:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.879457:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1789776537.879467:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:2412:x1876716432704000:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776537.879483:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776537.879489:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879524:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879550:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:2.0:1789776537.879556:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879586:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879592:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879611:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776537.879670:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:2412:x1876716432704000:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 203us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776537.879678:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00010000:00010000:2.0:1789776537.879831:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb884e42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab57dc expref: 14 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.879848:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553024:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776537.879869:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879878:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.879884:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.880096:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.880108:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 14 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.880125:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.880151:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 14 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.880164:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 14 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.880177:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553152:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776537.881188:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776537.886059:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553152:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776537.886094:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776537.887297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.887552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704128 00000100:00100000:1.0:1789776537.887561:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704128 00010000:00010000:1.0:1789776537.887601:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.887646:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:1.0:1789776537.887657:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:2412:x1876716432704128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776537.887673:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776537.887680:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887693:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887717:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb884fbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab583e expref: 15 pid: 13443 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887733:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:1.0:1789776537.887739:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887749:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887767:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.887807:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776537.887839:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.887848:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.887875:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:2412:x1876716432704128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 220us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.887882:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000001:00080000:3.0:1789776537.888278:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789776537.888414:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789776537.888447:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789776537.888585:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876716449553280:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789776537.888634:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776537.888666:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776537.888829:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449553280 00000100:00100000:1.0:1789776537.888836:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449553280 00000100:00100000:1.0:1789776537.888879:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789776537.888887:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1876716449553280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776537.888971:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1876716449553280:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.888979:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789776537.889060:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789776537.889066:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cff491180, transno 4294967304 00000100:00100000:3.0:1789776537.889122:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876716449553280:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789776537.889236:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789776537.889276:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876716449553408:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789776537.889302:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776537.889333:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776537.889575:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449553408 00000100:00100000:1.0:1789776537.889580:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449553408 00000100:00100000:1.0:1789776537.889609:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789776537.889617:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876716449553408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776537.889711:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1876716449553408:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (407us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789776537.889717:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789776537.890088:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876716449553408:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789776537.890127:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890137:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890145:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890152:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.890157:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890165:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890180:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:3.0:1789776537.890183:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776537.890188:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890194:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885009 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890226:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890232:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890237:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890250:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776537.890254:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890260:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890268:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:3.0:1789776537.890271:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776537.890274:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890279:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb884f37 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890300:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890313:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890322:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890348:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.890362:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 17 pid: 6518 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.890384:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff483100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553536:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776537.890459:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776537.892641:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff483100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449553536:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776537.892671:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776537.893531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776537.893584:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704256 00000100:00100000:1.0:1789776537.893600:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704256 00010000:00010000:1.0:1789776537.893636:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 18 pid: 6518 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776537.893673:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1789776537.893683:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2411:x1876716432704256:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776537.893697:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776537.893703:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 18 pid: 6518 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893716:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 18 pid: 6518 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893741:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb884f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5822 expref: 18 pid: 6518 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893757:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776537.893763:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893775:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893783:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.893821:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776537.893870:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2411:x1876716432704256:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 188us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776537.893887:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:1.0:1789776537.894136:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894146:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894158:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894165:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894173:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894179:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776537.894183:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894191:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.894200:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776537.894203:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776537.894207:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895035:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885010 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895054:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895067:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895073:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895153:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776537.895158:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895164:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895175:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776537.895177:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776537.895181:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776537.895186:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885002 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776537.895690:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776537.895696:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776537.895711:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789776537.895717:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776537.895822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11301:x1876716432703872:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 19756us (19955us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789776537.895834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00000020:00080000:1.0:1789776537.895840:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789776537.899571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776537.899911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704512 00000100:00100000:2.0:1789776537.899919:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704512 00000100:00100000:2.0:1789776537.900140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1789776537.900152:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11301:x1876716432704512:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789776537.900411:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789776537.900445:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789776537.900485:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900528:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900539:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900563:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900569:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900576:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776537.900592:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776537.900681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:11301:x1876716432704512:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 531us (1122us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789776537.900690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000020:00080000:2.0:1789776537.900694:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776537.900786:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776537.900806:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.900814:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776537.900818:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.900826:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.900838:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:3.0:1789776537.900841:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789776537.900846:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.900852:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885017 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776537.900864:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776537.900866:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776537.900868:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776538.018803:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776538.146778:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776538.146810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449553792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776538.146881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776538.146945:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449553792 00000100:00100000:3.0:1789776538.146953:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449553792 00000100:00100000:2.0:1789776538.146977:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449553664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776538.147027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776538.147031:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789776538.147043:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449553792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776538.147083:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1789776538.147083:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449553664 00000100:00100000:2.0:1789776538.147089:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449553664 00000100:00100000:2.0:1789776538.147112:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789776538.147120:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449553664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776538.147132:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789776538.147138:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449553792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.147147:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776538.147174:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449553664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776538.147182:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789776538.147216:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449553664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776538.147311:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776538.147338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449553792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776538.659009:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449554048:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776538.659125:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449554560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776538.659175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449555072:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776538.659235:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789776538.659242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449554176:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776538.659284:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449554688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776538.659330:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554048 00000100:00100000:0.0:1789776538.659337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554048 00000100:00100000:0.0:1789776538.659382:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554560 00000100:00100000:0.0:1789776538.659398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554560 00000100:00100000:0.0:1789776538.659429:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554688 00000100:00100000:0.0:1789776538.659431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554688 00000100:00100000:0.0:1789776538.659447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789776538.659457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449554048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.659530:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789776538.659537:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449554048:12345-0@lo:400:kworker.0 Request processed in 79us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776538.659545:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449554560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.659546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789776538.659569:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789776538.659589:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449554688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.659799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449554304:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.660045:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449554688:12345-0@lo:400:kworker.0 Request processed in 468us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776538.660053:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789776538.660074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449555072 00000100:00100000:0.0:1789776538.660077:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449555072 00000100:00100000:0.0:1789776538.660114:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789776538.660120:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449555072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.660148:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc81f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449554560:12345-0@lo:400:kworker.0 Request processed in 606us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.660149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776538.660165:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789776538.660176:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449555072:12345-0@lo:400:kworker.0 Request processed in 55us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.660183:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449554816:0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.660184:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554304 00000100:00100000:0.0:1789776538.660185:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776538.660190:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554304 00000100:00100000:2.0:1789776538.660217:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789776538.660223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776538.660227:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449554304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.660315:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789776538.660323:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449553920:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.660374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554816 00000100:00100000:0.0:1789776538.660379:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554816 00000100:00100000:0.0:1789776538.660403:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789776538.660410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449554816:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789776538.660634:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776538.661028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776538.661063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449554432:0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.661091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776538.661110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449554944:0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.661132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776538.661146:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449555328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776538.661170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789776538.661191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776538.661195:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776538.661201:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449555200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776538.661219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449553920 00000100:00100000:1.0:1789776538.661225:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449553920 00000100:00100000:3.0:1789776538.661229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776538.661266:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789776538.661275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449553920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776538.661598:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449553920:12345-0@lo:400:kworker.0 Request processed in 323us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776538.661605:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789776538.661686:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449555328 00000100:00100000:3.0:1789776538.661692:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449555328 00000100:00100000:3.0:1789776538.661724:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449555200 00000100:00100000:3.0:1789776538.661727:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449555200 00000100:00100000:1.0:1789776538.661744:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554176 00000100:00100000:3.0:1789776538.661748:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776538.661751:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554176 00000100:00100000:3.0:1789776538.661772:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876716449555328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776538.661794:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554432 00000100:00100000:1.0:1789776538.661799:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554432 00002000:00000024:3.0:1789776538.661809:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776538.661818:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776538.661827:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449554176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.661848:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876716449555328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.661855:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776538.661916:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449554176:12345-0@lo:400:kworker.0 Request processed in 90us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776538.661923:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776538.661937:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789776538.661942:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776538.662014:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789776538.662022:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449555200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789776538.662032:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776538.662063:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449555200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.662068:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789776538.662107:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449554432:12345-0@lo:400:kworker.0 Request processed in 163us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.662117:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449555200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776538.662124:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789776538.662144:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449554944 00000100:00100000:3.0:1789776538.662148:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449554944 00000100:00100000:3.0:1789776538.662179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789776538.662186:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449554944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.662202:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449554304:12345-0@lo:400:kworker.0 Request processed in 1975us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776538.662212:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789776538.662229:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449554944:12345-0@lo:400:kworker.0 Request processed in 43us (1095us total) trans 0 rc 0/0 00000100:00080000:1.0:1789776538.662344:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776538.662357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789776538.662382:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449555328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776538.662394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449553920:0@lo:400:kworker.0 00000100:00100000:1.0:1789776538.662404:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449554432:0@lo:400:kworker.0 00010000:00080000:1.0:1789776538.662418:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e2fb80 x1876716449554944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776538.662428:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449554944:0@lo:400:kworker.0 00000100:00100000:1.0:1789776538.662440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449554304:0@lo:400:kworker.0 00000100:00100000:1.0:1789776538.662449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449554816:0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.662475:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449554176:0@lo:400:kworker.0 00010000:00080000:2.0:1789776538.662526:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf0f73100 x1876716449554688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776538.662537:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449554688:0@lo:400:kworker.0 00000100:00100000:2.0:1789776538.662553:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449554048:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.662561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449554816:12345-0@lo:400:kworker.0 Request processed in 1797us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776538.662566:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449554560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776538.662573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789776538.662581:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449555072:0@lo:400:kworker.0 00010000:00010000:0.0:1789776539.043165:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776539.330393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.330440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.330472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.330489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776539.331006:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704640 00000100:00100000:2.0:1789776539.331016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704640 00000100:00100000:2.0:1789776539.331070:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 377 00000100:00100000:2.0:1789776539.331080:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432704640:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331248:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.331273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.331308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.331334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704896 00000100:00100000:1.0:1789776539.331338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704896 00000100:00100000:1.0:1789776539.331376:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705408 00000100:00100000:1.0:1789776539.331380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705408 00000100:00100000:1.0:1789776539.331395:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432704768 00000100:00100000:1.0:1789776539.331398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432704768 00000100:00100000:1.0:1789776539.331412:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705280 00000100:00100000:1.0:1789776539.331422:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705280 00000100:00100000:1.0:1789776539.331441:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 265 00000100:00100000:1.0:1789776539.331448:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432704896:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331605:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432704896:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 156us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 265 00000100:00100000:1.0:1789776539.331634:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:1.0:1789776539.331640:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432705408:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331667:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432705408:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331673:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 266 00000100:00100000:1.0:1789776539.331685:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 267 00000100:00100000:1.0:1789776539.331691:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2412:x1876716432704768:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331719:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2412:x1876716432704768:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331725:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 267 00000100:00100000:1.0:1789776539.331736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00100000:1.0:1789776539.331742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432705280:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331777:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432705280:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331784:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 268 00000100:00100000:1.0:1789776539.331809:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705152 00000100:00100000:1.0:1789776539.331813:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705152 00000100:00100000:1.0:1789776539.331840:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705024 00000100:00100000:1.0:1789776539.331850:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705024 00000100:00100000:1.0:1789776539.331874:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1789776539.331881:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432705152:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331906:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432705152:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331912:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1789776539.331924:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:1.0:1789776539.331930:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432705024:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776539.331950:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432705024:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.331956:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00080000:1.0:1789776539.331975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776539.331979:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776539.331981:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776539.331983:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776539.334063:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432704640:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2974us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776539.334078:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 377 00000040:00080000:3.0:1789776539.479986:0:14256:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776539.479995:0:14256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776539.480033:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789776539.480042:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776539.653077:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776539.653471:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705664 00000100:00100000:0.0:1789776539.653480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705664 00000100:00100000:0.0:1789776539.653546:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:0.0:1789776539.654677:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:11319:x1876716432705664:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776539.654699:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776539.654720:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88501e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab585a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.655099:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb885025 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.655114:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb885025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.655125:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb885025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776539.655135:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789776539.655234:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88501e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab585a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.655251:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb885025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab585a expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.655259:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:0.0:1789776539.655262:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789776539.655266:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8000, rc 0) 00000100:00100000:0.0:1789776539.655343:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11319:x1876716432705664:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1788us (2276us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789776539.655370:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:0.0:1789776539.662650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.662708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432705792 00000100:00100000:1.0:1789776539.662720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432705792 00000100:00100000:1.0:1789776539.662802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:1.0:1789776539.662814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11319:x1876716432705792:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1789776539.662895:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.662915:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.662927:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.662956:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.662964:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.662971:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663051:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663060:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663067:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776539.663111:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663124:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663129:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663135:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663140:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.663144:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663158:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663170:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776539.663172:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.663176:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663181:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885033 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663194:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663199:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663204:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663209:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.663211:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663216:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663222:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5cc3edef00) 00010000:00010000:1.0:1789776539.663224:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.663226:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663241:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88503a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663257:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663263:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663269:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663273:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fe00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.663277:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663283:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663291:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cc3edee00) 00010000:00010000:1.0:1789776539.663295:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.663298:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.663304:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776539.664093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11319:x1876716432705792:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 1277us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.664103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:3.0:1789776539.763050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776539.763416:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706048 00000100:00100000:0.0:1789776539.763426:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706048 00000100:00100000:0.0:1789776539.763533:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:0.0:1789776539.763543:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc35e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11322:x1876716432706048:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776539.763578:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776539.763602:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885048 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5861 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763676:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763692:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763705:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763719:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763727:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763734:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763872:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763893:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776539.763901:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776539.763913:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789776539.764028:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764036:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764042:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764048:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.764053:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764061:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764073:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776539.764076:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.764081:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764087:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88504f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764100:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764105:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764110:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764125:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.764128:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764135:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764142:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5cf512de00) 00010000:00010000:1.0:1789776539.764144:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.764146:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764151:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764190:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885048 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 23 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764203:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 22 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.764209:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776539.764211:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776539.764213:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9000, rc 0) 00000100:00100000:1.0:1789776539.764294:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc35e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:11322:x1876716432706048:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 752us (1261us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789776539.764302:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:0.0:1789776539.774871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.780436:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706176 00000100:00100000:1.0:1789776539.780474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706176 00000100:00100000:1.0:1789776539.781017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:1.0:1789776539.781032:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:11322:x1876716432706176:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1789776539.781121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781138:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781150:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781198:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781206:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781214:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781220:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fe00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.781224:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781233:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781245:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776539.781248:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776539.781253:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.781271:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88506b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776539.781385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:11322:x1876716432706176:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 356us (6523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.781394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:2.0:1789776539.784638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776539.784991:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706432 00000100:00100000:0.0:1789776539.785001:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706432 00000100:00100000:0.0:1789776539.785091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776539.785113:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:11322:x1876716432706432:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776539.785366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:11322:x1876716432706432:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 265us (739us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789776539.785373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1789776539.864653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776539.865153:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706688 00000100:00100000:2.0:1789776539.865163:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706688 00000100:00100000:2.0:1789776539.865232:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:2.0:1789776539.865244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:10841:x1876716432706688:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776539.865272:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776539.865305:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885072 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5868 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.865441:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.865458:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 24 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.865468:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.865546:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 24 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.865561:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 24 pid: 13443 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776539.865576:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449555456:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776539.865679:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776539.870959:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449555456:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776539.871005:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776539.871231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776539.871910:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706816 00000100:00100000:3.0:1789776539.871920:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706816 00010000:00010000:3.0:1789776539.872167:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 25 pid: 13443 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776539.872461:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1789776539.872474:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:2412:x1876716432706816:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776539.872540:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776539.872550:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 25 pid: 13443 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872564:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 25 pid: 13443 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872588:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb88505d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5861 expref: 25 pid: 13443 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872606:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:3.0:1789776539.872699:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872708:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872715:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776539.872750:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776539.872821:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:2412:x1876716432706816:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 349us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776539.872846:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00010000:00010000:2.0:1789776539.873566:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.873590:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776539.873621:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789776539.873768:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885072 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.873787:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.873795:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776539.873798:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776539.873801:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3600, rc 0) 00000100:00100000:2.0:1789776539.873857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:10841:x1876716432706688:12345-192.168.204.27@tcp:101:bash.0 Request processed in 8614us (9213us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789776539.873866:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:1.0:1789776539.877281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776539.880676:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432706944 00000100:00100000:2.0:1789776539.880692:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432706944 00000100:00100000:2.0:1789776539.880833:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:2.0:1789776539.880845:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:10841:x1876716432706944:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776539.880871:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776539.880892:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885087 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab586f expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.880966:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb88508e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.880983:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb88508e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.881004:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb88508e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.882458:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885087 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab586f expref: 26 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.882483:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb88508e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab586f expref: 25 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.882505:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776539.882508:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776539.882512:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3e00, rc 0) 00000100:00100000:2.0:1789776539.882598:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:10841:x1876716432706944:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1754us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776539.882606:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:0.0:1789776539.888374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.888551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707200 00000100:00100000:1.0:1789776539.888564:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707200 00000100:00100000:1.0:1789776539.888640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:1.0:1789776539.888653:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:10841:x1876716432707200:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1789776539.888917:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.888938:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.888950:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776539.888996:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789776539.889020:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b1de8c8 reply state 0000000082e758ac transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.889034:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.889056:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776539.889074:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776539.889079:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789776539.889124:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789776539.889239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:10841:x1876716432707200:12345-192.168.204.27@tcp:36:bash.0 Request processed in 587us (875us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789776539.889247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000020:00080000:1.0:1789776539.889253:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789776539.893642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776539.893742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707328 00000100:00100000:2.0:1789776539.893753:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707328 00000100:00100000:2.0:1789776539.893825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:2.0:1789776539.893836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:10841:x1876716432707328:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776539.893863:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776539.893884:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88509c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5876 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.893971:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88509c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5876 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.893986:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88509c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5876 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776539.894017:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776539.894021:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776539.894025:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776539.894097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:10841:x1876716432707328:12345-192.168.204.27@tcp:101:bash.0 Request processed in 262us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776539.894104:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:0.0:1789776539.897720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.897896:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707456 00000100:00100000:1.0:1789776539.897906:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707456 00000100:00100000:1.0:1789776539.897978:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1789776539.897989:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:10841:x1876716432707456:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776539.898161:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776539.898184:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab587d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776539.898211:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd299, atime: 0x6aadd298, ctime: 0x6aadd299, blocks: 0x8 00010000:00010000:1.0:1789776539.898234:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789776539.898239:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776539.898247:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.898266:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.898281:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217f000, rc 0) 00000100:00100000:1.0:1789776539.898351:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:10841:x1876716432707456:12345-192.168.204.27@tcp:101:bash.0 Request processed in 363us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.898377:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1789776539.902444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.902832:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707584 00000100:00100000:1.0:1789776539.902843:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707584 00002000:00010000:1.0:1789776539.902888:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1789776539.902892:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cd8825880 with x1876716432707584 ext(0->18446744073709551615) 00002000:00010000:1.0:1789776539.902904:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cd8825880. 00000100:00100000:1.0:1789776539.903107:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1789776539.903119:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432707584:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:1.0:1789776539.903417:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789776539.903421:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789776537 -> 1789776541 00002000:00010000:1.0:1789776539.903424:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789776536 -> 1789776536 00002000:00010000:1.0:1789776539.903426:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789776537 -> 1789776541 00002000:00010000:1.0:1789776539.903429:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789776539.903539:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432707584:12345-192.168.204.27@tcp:10:bash.0 Request processed in 421us (1103us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789776539.903547:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00010000:1.0:1789776539.903552:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1789776539.903554:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cd8825880 with x1876716432707584 ext(0->18446744073709551615) 00002000:00010000:1.0:1789776539.903560:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cd8825880. 00000100:00100000:2.0:1789776539.998649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776539.999052:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707712 00000100:00100000:1.0:1789776539.999064:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707712 00000100:00100000:1.0:1789776539.999264:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1789776539.999277:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11336:x1876716432707712:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1789776539.999365:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999411:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999423:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999440:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999448:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999455:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999570:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999580:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999587:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776539.999632:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999643:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999650:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999667:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999673:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ee00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.999677:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999701:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999714:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776539.999717:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.999721:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999727:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999742:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999748:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999785:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999790:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ea00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.999793:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999810:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999819:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776539.999822:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.999825:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999831:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999846:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999853:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999857:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999862:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776539.999865:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999870:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999877:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776539.999879:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776539.999882:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776539.999897:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776539.999985:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11336:x1876716432707712:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 709us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776539.999993:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00010000:00010000:3.0:1789776540.066716:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776540.067096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.067186:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432707968 00000100:00100000:1.0:1789776540.067197:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432707968 00000100:00100000:1.0:1789776540.067264:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:1.0:1789776540.067275:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11339:x1876716432707968:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776540.067295:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776540.067318:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067396:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067412:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067437:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067455:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067463:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067524:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067635:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8850d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067646:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8850d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067654:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8850d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776540.067664:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789776540.067935:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067944:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067952:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067958:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ea00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776540.067963:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067972:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.067985:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776540.067989:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776540.068000:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068008:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8850c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068025:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068032:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068039:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068045:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ee00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776540.068048:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068055:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068063:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776540.068066:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776540.068069:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068075:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8850cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068118:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8850bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5884 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068147:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8850d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5884 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.068155:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776540.068157:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789776540.068160:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:1.0:1789776540.068237:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11339:x1876716432707968:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 964us (1147us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789776540.068246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:0.0:1789776540.071615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.071795:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432708096 00000100:00100000:1.0:1789776540.071806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432708096 00000100:00100000:1.0:1789776540.071871:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:1.0:1789776540.071883:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11339:x1876716432708096:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1789776540.071962:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.071981:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.071993:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.072035:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.072050:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 32 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776540.072081:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449555584:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776540.072179:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776540.077778:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2695180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449555584:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776540.077808:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776540.086044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.086649:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432708352 00000100:00100000:2.0:1789776540.086661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432708352 00000100:00100000:2.0:1789776540.086731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776540.086762:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:6178:x1876716432708352:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789776540.087075:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:6178:x1876716432708352:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 324us (1039us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789776540.087085:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1789776540.090456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.090547:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432708480 00000100:00100000:1.0:1789776540.090557:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432708480 00010000:00010000:1.0:1789776540.090597:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 34 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776540.090643:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:1.0:1789776540.090654:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:2412:x1876716432708480:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776540.090669:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776540.090677:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 34 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.090690:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 34 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.090713:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885079 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5868 expref: 34 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.090730:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:1.0:1789776540.090930:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.090957:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.090966:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.091001:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776540.091064:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:2412:x1876716432708480:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 411us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776540.091072:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00010000:00010000:0.0:1789776540.092993:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093011:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093086:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093093:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093100:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093105:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776540.093109:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093117:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093134:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:0.0:1789776540.093138:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776540.093142:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.093148:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8850e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776540.093251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11339:x1876716432708096:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 21365us (21642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.093261:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:0.0:1789776540.098101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.098333:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432708736 00000100:00100000:2.0:1789776540.098344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432708736 00000100:00100000:2.0:1789776540.098409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776540.098431:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:11339:x1876716432708736:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776540.098720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:11339:x1876716432708736:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 301us (629us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789776540.098729:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1789776540.206703:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.206825:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432708992 00000100:00100000:2.0:1789776540.206836:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432708992 00000100:00100000:2.0:1789776540.207186:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:2.0:1789776540.207198:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:11350:x1876716432708992:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1789776540.207223:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776540.207245:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8850e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab588b expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207331:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207346:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207357:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207371:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207379:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207384:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207534:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8850fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207555:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8850fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207563:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8850fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776540.207574:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789776540.207649:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207656:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207662:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207668:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.207672:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207680:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207692:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776540.207695:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.207699:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207705:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8850f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207718:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207730:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207735:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207739:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.207742:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207759:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207768:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776540.207770:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.207772:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207778:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8850f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207830:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8850e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab588b expref: 36 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207845:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8850fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab588b expref: 35 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.207861:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776540.207864:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776540.207873:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776540.207955:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11350:x1876716432708992:12345-192.168.204.27@tcp:101:cat.0 Request processed in 759us (1262us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789776540.207963:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:0.0:1789776540.215902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.216023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432709248 00000100:00100000:2.0:1789776540.216033:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432709248 00000100:00100000:2.0:1789776540.216106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776540.216117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11350:x1876716432709248:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:2.0:1789776540.216939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:11350:x1876716432709248:12345-192.168.204.27@tcp:35:cat.0 Request processed in 820us (1043us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789776540.216949:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1789776540.267542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.267620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432709504 00000100:00100000:2.0:1789776540.267631:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432709504 00000100:00100000:2.0:1789776540.267692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:2.0:1789776540.267703:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:11351:x1876716432709504:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:2.0:1789776540.267774:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789776540.267932:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88509c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5876 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.267965:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8850fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab588b expref: 35 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.267979:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8850d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5884 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.267993:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb88508e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab586f expref: 33 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268015:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776540.268020:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776540.268180:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268194:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268203:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268293:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268309:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268721:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.268739:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776540.269775:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789776540.269942:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361514448480ns, next at 362514444319ns, rc = 0 00010000:00010000:2.0:1789776540.270533:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270550:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270560:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270568:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270574:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270580:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270878:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776540.270906:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270912:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270920:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270925:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.270930:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.270937:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271680:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776540.271689:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271698:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776540.271702:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271709:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271723:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:0.0:1789776540.271726:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789776540.271730:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271736:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885121 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.271762:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776540.271764:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776540.271766:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776540.271858:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:2.0:1789776540.271861:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789776540.271865:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271871:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88511a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271892:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271898:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271904:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271910:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.271913:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271919:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271927:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776540.271930:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.271932:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.271938:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb88510c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776540.272360:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026e76b48 reply state 000000006b22a263 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.272374:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.272382:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776540.272384:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776540.272388:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776540.272746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:11351:x1876716432709504:12345-192.168.204.27@tcp:36:rm.0 Request processed in 5038us (5246us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789776540.272770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:0.0:1789776540.371656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.371774:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432709760 00000100:00100000:1.0:1789776540.371783:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432709760 00000100:00100000:1.0:1789776540.371855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:1.0:1789776540.371872:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:11357:x1876716432709760:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776540.371900:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776540.371923:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885128 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5892 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372034:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372052:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372063:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372074:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372096:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.372103:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776540.373364:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789776540.374383:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374407:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374418:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374522:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374530:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374537:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374543:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776540.374547:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374554:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374698:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776540.374700:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776540.374706:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374713:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88512f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776540.374728:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000248ab49f reply state 00000000f08f714a transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374738:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374745:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:1.0:1789776540.374760:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776540.374764:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789776540.374800:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885128 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374815:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.374822:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776540.374824:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776540.374826:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0800, rc 0) 00000100:00100000:1.0:1789776540.374919:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:11357:x1876716432709760:12345-192.168.204.27@tcp:101:bash.0 Request processed in 3054us (3429us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789776540.374929:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:0.0:1789776540.380738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.380997:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432709888 00000100:00100000:2.0:1789776540.382028:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432709888 00000100:00100000:2.0:1789776540.382261:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1789776540.382276:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2414:x1876716432709888:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776540.382305:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776540.382338:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5899 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776540.382373:0:8528:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776540.382472:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1789776540.382478:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776540.382508:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.382538:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.382649:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3c00, rc 0) 00000100:00100000:2.0:1789776540.382866:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2414:x1876716432709888:12345-192.168.204.27@tcp:101:bash.0 Request processed in 592us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776540.382875:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:0.0:1789776540.388226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.388471:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432710016 00000100:00100000:1.0:1789776540.388484:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432710016 00000100:00100000:1.0:1789776540.388888:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1789776540.388903:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:11357:x1876716432710016:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776540.388938:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776540.388966:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58a0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.389009:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.389020:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776540.389024:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776540.389031:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.389148:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.389166:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776540.389182:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876716449555712:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776540.389306:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776540.395192:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876716449555712:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776540.395249:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.395306:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1600, rc 0) 00000100:00100000:1.0:1789776540.395958:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:11357:x1876716432710016:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7055us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776540.395971:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1789776540.396057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776540.396133:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432710144 00000100:00100000:3.0:1789776540.396143:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432710144 00010000:00010000:3.0:1789776540.396182:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.396216:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776540.396225:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432710144:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776540.396242:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776540.396269:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.396284:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.396314:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a123aa/0xf13b8042cb88514b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5899 expref: 9 pid: 8528 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.396331:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776540.396336:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776540.396346:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.396376:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.396432:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.396450:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1876716449555840:192.168.204.27@tcp:105: 00000100:00100000:3.0:1789776540.396559:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc1254840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776540.411234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.412059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432710400 00000100:00100000:0.0:1789776540.412073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432710400 00000100:00100000:0.0:1789776540.412156:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1789776540.412169:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:11357:x1876716432710400:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1789776540.413311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11357:x1876716432710400:12345-192.168.204.27@tcp:35:bash.0 Request processed in 1136us (2084us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789776540.413348:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1789776540.414089:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1876716449555840:192.168.204.27@tcp:105: 00010000:00010000:3.0:1789776540.414122:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776540.414164:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432710144:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 17938us (18107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776540.414175:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776540.601659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.602711:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432710528 00000100:00100000:2.0:1789776540.602737:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432710528 00000100:00100000:2.0:1789776540.602908:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:2.0:1789776540.602923:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:11373:x1876716432710528:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776540.602971:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776540.603000:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58a7 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603094:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603113:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603128:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776540.603200:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789776540.603205:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776540.603231:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603265:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a7 expref: 40 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603309:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a7 expref: 39 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.603320:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776540.603323:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776540.603328:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776540.603449:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:11373:x1876716432710528:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 529us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776540.603457:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:0.0:1789776540.609131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.610058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432710784 00000100:00100000:1.0:1789776540.610074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432710784 00000100:00100000:1.0:1789776540.610164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:1.0:1789776540.610177:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:11373:x1876716432710784:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776540.610207:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776540.610236:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885167 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.610660:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88516e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.610679:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88516e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.610693:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88516e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776540.610709:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789776540.610989:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885167 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ae expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.611016:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88516e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ae expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.611053:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776540.611056:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776540.611060:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776540.611223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:11373:x1876716432710784:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1049us (2107us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789776540.611231:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:2.0:1789776540.634570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.634696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711040 00000100:00100000:1.0:1789776540.634711:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711040 00000100:00100000:1.0:1789776540.634827:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:2.0:1789776540.634843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.634844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:11373:x1876716432711040:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776540.634884:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776540.634924:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88517c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.635079:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.635098:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.635113:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776540.635128:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789776540.635264:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88517c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58b5 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.635310:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58b5 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.635319:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776540.635322:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789776540.635326:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0400, rc 0) 00000100:00100000:1.0:1789776540.635408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:11373:x1876716432711040:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 570us (851us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789776540.635416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:0.0:1789776540.635528:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711168 00000100:00100000:0.0:1789776540.635534:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711168 00000100:00100000:0.0:1789776540.635577:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1789776540.635585:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:2412:x1876716432711168:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776540.635597:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776540.635615:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88516e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ae expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.635628:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:0.0:1789776540.635631:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776540.635653:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:2412:x1876716432711168:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 70us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.635661:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1789776540.652764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.658253:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711296 00000100:00100000:0.0:1789776540.658278:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711296 00000100:00100000:0.0:1789776540.658390:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1789776540.658404:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432711296:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:0.0:1789776540.658469:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.658656:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.658668:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776540.658692:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776540.658697:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.660063:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.660090:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 8 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776540.660112:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876716449555968:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776540.660259:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776540.672249:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876716449555968:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776540.672293:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.675426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.676652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711424 00000100:00100000:1.0:1789776540.676668:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711424 00002000:00100000:1.0:1789776540.676754:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a5cff349f80 x1876716432711424/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:731/0 lens 504/0 e 0 to 0 dl 1789776551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776540.676780:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff349f80 with x1876716432711424 ext(0->8) 00010000:00010000:1.0:1789776540.676800:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.676822:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776540.676832:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5cff349f80 00000100:00100000:1.0:1789776540.676878:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1789776540.676891:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432711424:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:1.0:1789776540.685318:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432711424:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 8410us (9889us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789776540.685355:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00100000:1.0:1789776540.685373:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a5cff349f80 x1876716432711424/t4294967303(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:731/0 lens 504/448 e 0 to 0 dl 1789776551 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776540.685386:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff349f80 with x1876716432711424 ext(0->8) 00010000:00010000:1.0:1789776540.685401:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 11 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.685427:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 11 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776540.685436:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5cff349f80 00000001:00080000:2.0:1789776540.689662:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1789776540.689691:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1789776540.694867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776540.695047:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711552 00000100:00100000:3.0:1789776540.695062:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711552 00010000:00010000:3.0:1789776540.695119:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.695180:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:3.0:1789776540.695192:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2414:x1876716432711552:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776540.695212:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789776540.695250:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789776540.695253:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789776541 00002000:00010000:3.0:1789776540.695256:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789776541 00002000:00010000:3.0:1789776540.695258:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789776541 00002000:00010000:3.0:1789776540.695261:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789776540.695268:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.695285:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.695317:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037cb3a1e/0xf13b8042cb885152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a0 expref: 9 pid: 8432 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.695340:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776540.695346:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776540.695353:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.695372:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.695415:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776540.695535:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.695547:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.695572:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.695581:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.695598:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.695607:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776540.695613:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.696216:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.696274:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.696283:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e4fb84/0xf13b8042cb885191 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.700902:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2414:x1876716432711552:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 5693us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.701245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432711296:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 42841us (48508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.701263:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1789776540.702295:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1789776540.710167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776540.710411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711808 00000100:00100000:1.0:1789776540.710425:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711808 00000100:00100000:1.0:1789776540.710545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1789776540.710559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:11373:x1876716432711808:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:1.0:1789776540.710649:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58b5 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776540.711224:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789776540.711264:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789776540.712160:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789776540.712231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.712256:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.712280:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.712336:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.712354:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 46 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776540.712373:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876716449556096:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776540.713453:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776540.718429:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.718676:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc2697480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876716449556096:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776540.718717:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776540.720205:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432711936 00000100:00100000:0.0:1789776540.720222:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432711936 00010000:00010000:1.0:1789776540.720611:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 47 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776540.721067:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1789776540.721083:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:2411:x1876716432711936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776540.721109:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776540.721119:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 47 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721136:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 47 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721163:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb88513d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5892 expref: 47 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721208:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:1.0:1789776540.721214:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721226:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721236:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776540.721286:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776540.721425:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+46:2411:x1876716432711936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 346us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776540.721434:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00010000:00010000:3.0:1789776540.721521:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.721538:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776540.721696:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789776540.721879:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789776540.722018:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449556224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789776540.722099:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776540.722145:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776540.724152:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449556224 00000100:00100000:0.0:1789776540.724173:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449556224 00000100:00100000:0.0:1789776540.724280:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789776540.724296:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449556224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789776540.724543:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449556224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 251us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.724551:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789776540.724646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776540.724697:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789776540.724705:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1789776540.724735:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cd8824a80, transno 4294967302 00000100:00100000:3.0:1789776540.724781:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449556224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789776540.725004:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789776540.725103:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449556352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789776540.725157:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776540.725195:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449556352 00000100:00100000:3.0:1789776540.725201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449556352 00000100:00100000:3.0:1789776540.725236:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789776540.725243:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449556352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789776540.725376:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1876716449556352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (218us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789776540.725384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789776540.725408:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc36679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776540.725430:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449556352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789776540.725484:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789776540.725565:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725579:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725589:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725597:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776540.725602:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725612:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725633:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:3.0:1789776540.725638:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789776540.725645:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.725652:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885198 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776540.725792:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789776540.725889:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789776540.725903:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361970409930ns, next at 362970406409ns, rc = 0 00000001:00080000:3.0:1789776540.725911:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789776540.725936:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cc3ede100) 00010000:00010000:3.0:1789776540.725939:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776540.725948:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885183 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58b5 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776540.726085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:11373:x1876716432711808:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 15529us (15934us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789776540.726095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000020:00080000:3.0:1789776540.726099:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789776540.742589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.745022:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432712064 00000100:00100000:0.0:1789776540.745045:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432712064 00000100:00100000:0.0:1789776540.745402:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:0.0:1789776540.745418:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:11373:x1876716432712064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776540.745451:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776540.745483:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88519f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.746113:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88519f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58bc expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.746133:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88519f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58bc expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.746159:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776540.746163:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776540.746169:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9a00, rc 0) 00000100:00100000:0.0:1789776540.746310:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:11373:x1876716432712064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 894us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.746319:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:2.0:1789776540.752859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.753164:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432712320 00000100:00100000:0.0:1789776540.753189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432712320 00000100:00100000:0.0:1789776540.753269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1789776540.753284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:11373:x1876716432712320:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776540.753677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:11373:x1876716432712320:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 396us (833us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789776540.753687:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1789776540.895139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776540.895243:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432712448 00000100:00100000:2.0:1789776540.895257:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432712448 00000100:00100000:2.0:1789776540.895394:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:2.0:1789776540.895409:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:11383:x1876716432712448:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1789776540.895568:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895611:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895629:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895645:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895653:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895660:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895773:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895781:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895789:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776540.895850:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895865:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895872:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895894:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895900:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.895905:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895925:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895939:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:2.0:1789776540.895942:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.895947:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895953:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8851a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895968:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895972:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895977:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.895982:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.895985:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896001:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896009:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:2.0:1789776540.896011:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.896015:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896021:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8851ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896032:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896038:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896045:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896051:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776540.896054:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896060:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896068:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776540.896070:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776540.896073:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776540.896089:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8851b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776540.896195:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:11383:x1876716432712448:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 789us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776540.896205:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:2.0:1789776540.956288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776540.956400:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432712704 00000100:00100000:3.0:1789776540.956414:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432712704 00000100:00100000:3.0:1789776540.956523:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:3.0:1789776540.956536:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:11386:x1876716432712704:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776540.956565:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776540.956594:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8851bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58c3 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.956686:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.958855:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.958889:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.958923:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.958932:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.958939:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959375:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959387:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959395:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776540.959409:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789776540.959548:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959557:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959565:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959571:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776540.959577:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959584:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959599:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776540.959602:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776540.959608:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959627:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8851c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959643:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959649:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959656:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959661:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776540.959664:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959671:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959679:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:3.0:1789776540.959682:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776540.959685:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959691:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8851c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959840:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8851bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 54 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959871:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 53 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776540.959880:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776540.959882:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776540.959885:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c000, rc 0) 00000100:00100000:3.0:1789776540.959995:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11386:x1876716432712704:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3461us (3720us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789776540.960006:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:3.0:1789776540.965162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.965527:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432712832 00000100:00100000:0.0:1789776540.965540:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432712832 00000100:00100000:0.0:1789776540.965608:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:0.0:1789776540.965621:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11386:x1876716432712832:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1789776540.965733:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.965766:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.965782:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.965830:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966037:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966046:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966053:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776540.966058:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966066:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966102:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776540.966106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776540.966113:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776540.966119:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb8851de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776540.966213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11386:x1876716432712832:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 593us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.966221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:1.0:1789776540.970329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776540.970436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713088 00000100:00100000:0.0:1789776540.970451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713088 00000100:00100000:0.0:1789776540.970549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1789776540.970564:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:11386:x1876716432713088:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776540.971155:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11386:x1876716432713088:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 591us (838us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789776540.971165:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1789776541.059671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.059821:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713344 00000100:00100000:1.0:1789776541.059837:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713344 00000100:00100000:1.0:1789776541.059933:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1789776541.059947:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11396:x1876716432713344:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776541.059980:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776541.059985:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776541.060023:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58a7 expref: 54 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060050:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776541.060058:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776541.060098:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8851e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58ca expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060261:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060277:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 54 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060288:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060333:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 54 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.060350:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 54 pid: 10345 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.060367:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556480:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776541.060563:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789776541.060864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776541.063799:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556480:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776541.063843:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776541.065219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.065539:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713472 00000100:00100000:1.0:1789776541.065551:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713472 00010000:00010000:1.0:1789776541.065608:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 55 pid: 10345 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.065690:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:1.0:1789776541.065710:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:2411:x1876716432713472:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776541.065731:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776541.065752:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 55 pid: 10345 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065768:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 55 pid: 10345 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065797:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8851d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58c3 expref: 55 pid: 10345 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065817:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.065824:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065834:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065844:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.065893:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776541.066225:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.066236:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776541.066261:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789776541.066434:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8851e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 56 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.066453:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 55 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.066461:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776541.066464:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776541.066467:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0200, rc 0) 00000100:00100000:1.0:1789776541.066583:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:2411:x1876716432713472:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 875us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.066594:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:2.0:1789776541.069260:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11396:x1876716432713344:12345-192.168.204.27@tcp:101:bash.0 Request processed in 9300us (9589us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789776541.069287:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1789776541.074756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776541.074937:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713600 00000100:00100000:3.0:1789776541.074952:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713600 00000100:00100000:3.0:1789776541.075030:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:3.0:1789776541.075053:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:11396:x1876716432713600:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776541.075088:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776541.075115:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8851fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58d1 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.075159:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.075175:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.075189:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.076188:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8851fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 56 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.076215:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 55 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.076226:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776541.076229:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789776541.076234:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ca00, rc 0) 00000100:00100000:3.0:1789776541.076400:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:11396:x1876716432713600:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1357us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.076411:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:0.0:1789776541.086794:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.087108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713856 00000100:00100000:1.0:1789776541.087143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713856 00000100:00100000:1.0:1789776541.087229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:1.0:1789776541.087242:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:11396:x1876716432713856:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1789776541.087605:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.087629:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.087643:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776541.087708:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1789776541.088423:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000035942ca reply state 00000000d87dfc87 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.088455:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.088474:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.088477:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776541.088482:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776541.090712:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11396:x1876716432713856:12345-192.168.204.27@tcp:36:bash.0 Request processed in 3457us (3920us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789776541.090726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000020:00080000:1.0:1789776541.090745:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789776541.103089:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776541.110633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.114039:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432713984 00000100:00100000:1.0:1789776541.114055:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432713984 00000100:00100000:1.0:1789776541.114227:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:1.0:1789776541.114238:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11396:x1876716432713984:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776541.114281:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776541.114304:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88520f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58d8 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.114429:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.114445:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 59 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.114455:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.114490:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 59 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.114523:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 59 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.114536:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556608:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776541.114650:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776541.123296:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556608:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776541.123332:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776541.127007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.130680:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432714112 00000100:00100000:1.0:1789776541.130696:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432714112 00010000:00010000:1.0:1789776541.130760:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 60 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.130899:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1789776541.130911:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:2411:x1876716432714112:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776541.130928:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776541.130936:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 60 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.130950:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 60 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.130975:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8851ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ca expref: 60 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.130992:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.130997:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.131006:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.131012:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.131045:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776541.131122:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:2411:x1876716432714112:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 213us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.131130:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00010000:00010000:2.0:1789776541.131309:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.131318:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776541.131375:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789776541.131380:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776541.131414:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.131444:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88520f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 59 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.131461:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 58 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.131469:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776541.131471:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776541.131474:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:2.0:1789776541.131552:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11396:x1876716432713984:12345-192.168.204.27@tcp:101:bash.0 Request processed in 17315us (20997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776541.131560:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1789776541.136330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776541.136881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432714368 00000100:00100000:3.0:1789776541.136979:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432714368 00000100:00100000:3.0:1789776541.137067:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1789776541.137078:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:11396:x1876716432714368:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1789776541.137804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11396:x1876716432714368:12345-192.168.204.27@tcp:35:bash.0 Request processed in 723us (1478us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789776541.137814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1789776541.226477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776541.226666:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432714496 00000100:00100000:3.0:1789776541.226680:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432714496 00000100:00100000:3.0:1789776541.226780:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:3.0:1789776541.226793:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:11402:x1876716432714496:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776541.226827:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776541.226857:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88521d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58df expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.226981:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.227002:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.227016:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776541.227076:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789776541.227080:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776541.227105:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.227137:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88521d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58df expref: 61 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.227160:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58df expref: 60 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.227170:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776541.227173:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776541.227177:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:3.0:1789776541.230248:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432714496:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3438us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.230264:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:2.0:1789776541.234880:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.235131:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432714624 00000100:00100000:1.0:1789776541.235165:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432714624 00000100:00100000:1.0:1789776541.235239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:1.0:1789776541.235252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432714624:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776541.235281:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776541.235312:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88522b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235402:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235422:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235451:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235467:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235477:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235485:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235885:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235909:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.235920:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776541.235990:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789776541.235994:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776541.236013:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236025:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236034:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236041:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236048:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236054:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776541.236058:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236065:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236077:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776541.236080:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776541.236084:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236209:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885232 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236238:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236245:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236250:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236256:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776541.236259:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236265:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236274:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:1.0:1789776541.236276:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776541.236279:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236285:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885239 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88522b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58e6 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236333:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58e6 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.236354:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.236356:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776541.236359:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0400, rc 0) 00000100:00100000:1.0:1789776541.236439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11402:x1876716432714624:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1189us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.236447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1789776541.242169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776541.242231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.242310:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715008 00000100:00100000:1.0:1789776541.242327:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715008 00000100:00100000:3.0:1789776541.242416:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432714752 00000100:00100000:1.0:1789776541.242417:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1789776541.242430:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432714752 00000100:00100000:1.0:1789776541.242435:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11402:x1876716432715008:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776541.242468:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776541.242519:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885247 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58ed expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.242650:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776541.242700:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1789776541.242713:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:2412:x1876716432714752:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776541.242742:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776541.242771:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 63 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.242786:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58e6 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.242794:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.242987:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776541.242995:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.243006:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.243013:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776541.243614:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:2412:x1876716432714752:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 387us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.243629:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00010000:00010000:1.0:1789776541.243778:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58e6 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.243829:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 61 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.243849:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 61 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.243866:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556864:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776541.244124:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776541.254663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.254761:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449556864:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776541.254798:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776541.255013:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715136 00000100:00100000:3.0:1789776541.255091:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715136 00010000:00010000:3.0:1789776541.255149:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 62 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776541.255276:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:1.0:1789776541.255298:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:2412:x1876716432715136:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776541.255317:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776541.255327:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 62 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255341:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 62 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255365:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885216 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d8 expref: 62 pid: 13443 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255382:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.255402:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255411:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255419:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.255573:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776541.255862:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:2412:x1876716432715136:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 574us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.255872:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00010000:00010000:2.0:1789776541.255973:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.255981:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776541.256001:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789776541.256241:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 62 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.256259:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 61 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776541.256266:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776541.256269:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776541.256272:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:2.0:1789776541.256301:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11402:x1876716432715008:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 13870us (14070us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789776541.256308:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:2.0:1789776541.266818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776541.267007:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715392 00000100:00100000:0.0:1789776541.267019:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715392 00000100:00100000:0.0:1789776541.267083:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776541.267095:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11402:x1876716432715392:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:0.0:1789776541.267111:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776541.267138:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb88519f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58bc expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.267182:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776541.267189:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776541.267242:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432715392:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 149us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.267249:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776541.278342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776541.278489:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715520 00000100:00100000:3.0:1789776541.278564:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715520 00000100:00100000:3.0:1789776541.278660:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:3.0:1789776541.278675:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432715520:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:3.0:1789776541.278849:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.278874:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776541.278924:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776541.279099:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789776541.279212:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432715520:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 540us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.279221:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1789776541.285175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776541.285282:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715648 00000100:00100000:0.0:1789776541.285300:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715648 00000100:00100000:0.0:1789776541.285385:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:0.0:1789776541.285399:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:11402:x1876716432715648:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776541.285427:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776541.285456:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.285583:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.285596:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.285765:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.285796:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.285814:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776541.285817:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776541.285822:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.285831:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9a00, rc 0) 00000100:00100000:1.0:1789776541.285966:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11402:x1876716432715648:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 567us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.285976:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1789776541.731780:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776541.731808:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449556992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776541.731887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776541.731968:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449557120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776541.732001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776541.732271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449556992 00000100:00100000:3.0:1789776541.732280:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449556992 00000100:00100000:2.0:1789776541.732303:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449557120 00000100:00100000:2.0:1789776541.732307:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449557120 00000100:00100000:2.0:1789776541.732333:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789776541.732356:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449556992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776541.732716:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776541.732779:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449556992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 424us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.733154:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449556992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776541.742237:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789776541.742266:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449557120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776541.742310:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789776541.742404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449557120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (10402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.742412:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789776541.742482:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449557120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776541.745214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000040:00080000:2.0:1789776541.986786:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776541.986795:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776541.986826:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789776541.986835:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776541.986955:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449557248:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776541.987042:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce01620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776541.993054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776541.993176:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449557248:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789776541.997312:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715776 00000100:00100000:3.0:1789776541.997336:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715776 00000100:00100000:3.0:1789776541.997522:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1789776541.997536:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11403:x1876716432715776:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776541.997583:0:13443:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776541.998021:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11403:x1876716432715776:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 485us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776541.998032:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:0.0:1789776542.006709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.009835:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432715904 00000100:00100000:3.0:1789776542.010085:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432715904 00000100:00100000:2.0:1789776542.010438:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:2.0:1789776542.010452:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11403:x1876716432715904:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789776542.010837:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010855:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010869:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010886:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010908:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010915:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010941:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010950:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.010957:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776542.011010:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789776542.011014:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776542.011027:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011038:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011045:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011052:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011059:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776542.011063:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011078:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011091:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:2.0:1789776542.011094:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776542.011100:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011106:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb88526a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011121:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011192:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011199:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011204:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776542.011207:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011214:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011222:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8a5bc1a87300) 00010000:00010000:2.0:1789776542.011225:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776542.011228:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011244:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885271 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011340:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011347:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011353:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011358:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776542.011362:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011367:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011376:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776542.011378:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776542.011381:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.011387:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2600/0xf13b8042cb885278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.013407:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11403:x1876716432715904:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 2945us (6697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.013422:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:0.0:1789776542.016486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.016788:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432716160 00000100:00100000:1.0:1789776542.016798:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432716160 00000100:00100000:1.0:1789776542.016989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:1.0:1789776542.017002:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:11403:x1876716432716160:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.017027:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.017048:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88527f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab58fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017187:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017199:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776542.017210:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776542.017294:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017301:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017308:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017314:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ee00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.017318:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017338:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017353:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.017355:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789776542.017361:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017367:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb885286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017410:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88527f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58fb expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017421:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:1.0:1789776542.017424:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776542.017428:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88527f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58fb expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.017439:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fa00, rc 0) 00000100:00100000:1.0:1789776542.017528:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716160:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 529us (1051us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789776542.017535:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:0.0:1789776542.025799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.026439:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432716288 00000100:00100000:2.0:1789776542.026449:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432716288 00000100:00100000:2.0:1789776542.026674:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:2.0:1789776542.026686:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716288:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776542.026740:0:13443:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776542.027049:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716288:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 366us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.027056:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:2.0:1789776542.037570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.038333:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432716544 00000100:00100000:1.0:1789776542.038348:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432716544 00000100:00100000:1.0:1789776542.038441:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1789776542.038456:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716544:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.038550:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.038554:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776542.038592:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58df expref: 62 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.038620:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:1.0:1789776542.038626:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776542.038645:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb885294 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5902 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776542.039635:0:10345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789776542.039912:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb88529b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.039932:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb88529b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.039946:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb88529b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.040028:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb885294 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5902 expref: 64 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.040049:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb88529b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5902 expref: 63 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.040057:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5cc3ede200) 00010000:00010000:1.0:1789776542.040060:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776542.040079:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ee00, rc 0) 00000100:00100000:1.0:1789776542.040537:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11403:x1876716432716544:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 2043us (3007us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789776542.040549:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1789776542.052636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.053204:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432716800 00000100:00100000:1.0:1789776542.053275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432716800 00000100:00100000:1.0:1789776542.053365:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:1.0:1789776542.053379:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11403:x1876716432716800:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.053467:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776542.053563:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb88529b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5902 expref: 63 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.053589:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5cc3ede200) 00010000:00010000:1.0:1789776542.053603:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776542.053636:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.053728:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.053742:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056016:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056047:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056062:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056142:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056150:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056158:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056184:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.056190:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056199:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056214:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:0.0:1789776542.056218:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.056223:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056230:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056932:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056940:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056946:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056953:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.056956:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056963:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056974:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa4716a35 (ffff8a5cf512de00) 00010000:00010000:0.0:1789776542.056977:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.056981:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.056988:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8852b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa4716a35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.057275:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716800:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 3892us (4657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776542.057287:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:0.0:1789776542.060971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.061422:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432716928 00000100:00100000:2.0:1789776542.061436:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432716928 00000100:00100000:2.0:1789776542.061560:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:2.0:1789776542.061573:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:11403:x1876716432716928:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776542.061602:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776542.062671:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8852b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5909 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.062753:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.062839:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.062856:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.063053:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8852b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 64 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.063091:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 63 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.063101:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:2.0:1789776542.063104:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776542.063109:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776542.063211:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11403:x1876716432716928:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1640us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.063230:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:2.0:1789776542.069825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.069997:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432717184 00000100:00100000:1.0:1789776542.070015:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432717184 00000100:00100000:1.0:1789776542.070102:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:1.0:1789776542.070115:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:11403:x1876716432717184:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.070209:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.070240:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.070253:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776542.070405:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789776542.070414:0:10345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363314920657ns, next at 364314918207ns, rc = 0 00000004:00010000:1.0:1789776542.070461:0:10345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9a37779 reply state 00000000b1e81a86 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.070475:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.070482:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.070485:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789776542.070489:0:10345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776542.070637:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11403:x1876716432717184:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 524us (827us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789776542.070645:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:0.0:1789776542.076481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.077129:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432717312 00000100:00100000:1.0:1789776542.077146:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432717312 00000100:00100000:1.0:1789776542.077226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:1.0:1789776542.077238:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:11403:x1876716432717312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.077265:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.077289:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5910 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.077368:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.077384:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.077404:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.077408:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776542.077412:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ea00, rc 0) 00000100:00100000:1.0:1789776542.077595:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11403:x1876716432717312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 358us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.077603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1789776542.086025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.086456:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432717440 00000100:00100000:2.0:1789776542.086471:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432717440 00000100:00100000:2.0:1789776542.087142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1789776542.087162:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432717440:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789776542.087203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776542.087432:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432717440:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 271us (1411us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789776542.087441:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1789776542.092310:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.092750:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432717696 00000100:00100000:0.0:1789776542.092760:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432717696 00000100:00100000:0.0:1789776542.092849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776542.092859:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:11403:x1876716432717696:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776542.093103:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:11403:x1876716432717696:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 245us (804us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789776542.093110:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776542.096072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.096206:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432717952 00000100:00100000:2.0:1789776542.096216:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432717952 00000100:00100000:2.0:1789776542.096277:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:2.0:1789776542.096288:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:11403:x1876716432717952:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776542.096666:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:11403:x1876716432717952:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 379us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.096693:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:2.0:1789776542.099169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.099488:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718080 00000100:00100000:1.0:1789776542.099587:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718080 00000100:00100000:1.0:1789776542.099684:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:1.0:1789776542.099696:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:11403:x1876716432718080:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.099726:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.099749:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5917 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.099843:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.099857:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.099868:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776542.099936:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776542.099955:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.099984:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb8852d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5917 expref: 69 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.100082:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5917 expref: 68 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.100094:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.100097:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789776542.100102:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776542.100218:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:11403:x1876716432718080:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 523us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.100225:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:0.0:1789776542.110689:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.110835:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718208 00000100:00100000:2.0:1789776542.110845:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718208 00000100:00100000:2.0:1789776542.111026:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1789776542.111037:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432718208:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776542.111057:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776542.111080:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab591e expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776542.111107:0:8528:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd29f, blocks: 0x0 00010000:00010000:2.0:1789776542.111129:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789776542.111134:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776542.111144:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 10 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.111180:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 10 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.111195:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3c00, rc 0) 00000100:00100000:2.0:1789776542.112258:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:2412:x1876716432718208:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1216us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.112270:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00010000:00010000:3.0:1789776542.115603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776542.118478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.120054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718464 00000100:00100000:0.0:1789776542.120071:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718464 00000100:00100000:0.0:1789776542.120194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1789776542.120205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:11403:x1876716432718464:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789776542.120338:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:11403:x1876716432718464:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 135us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.120346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:3.0:1789776542.125704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.125967:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718592 00000100:00100000:1.0:1789776542.125977:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718592 00000100:00100000:1.0:1789776542.126108:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1789776542.126120:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:11403:x1876716432718592:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.126140:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.126172:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5925 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.126220:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.126244:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776542.126248:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776542.126255:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.126306:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.126319:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.126332:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449557376:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776542.126432:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776542.136043:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.136399:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449557376:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776542.136443:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.136465:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0800, rc 0) 00000100:00100000:1.0:1789776542.136554:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:11403:x1876716432718592:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 10435us (10859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.136563:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1789776542.136750:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718720 00000100:00100000:3.0:1789776542.136759:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718720 00010000:00010000:3.0:1789776542.136796:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.136876:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1789776542.136902:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2411:x1876716432718720:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776542.136926:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776542.136949:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.136964:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.136987:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8852e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab591e expref: 11 pid: 8528 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.137001:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776542.137006:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776542.137014:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.137024:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.137057:0:7458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.137071:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7458:1876716449557504:192.168.204.27@tcp:105: 00000100:00100000:1.0:1789776542.137124:0:7458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3426180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776542.145388:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7458:1876716449557504:192.168.204.27@tcp:105: 00010000:00010000:1.0:1789776542.145416:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776542.145521:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:2411:x1876716432718720:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 8592us (9458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.145533:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:0.0:1789776542.145835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.148372:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718848 00000100:00100000:3.0:1789776542.148388:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718848 00002000:00100000:3.0:1789776542.148444:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a5cff498000 x1876716432718848/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:733/0 lens 504/0 e 0 to 0 dl 1789776553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776542.148455:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff498000 with x1876716432718848 ext(0->12) 00002000:00010000:3.0:1789776542.148461:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff498000 00000100:00100000:3.0:1789776542.148888:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1789776542.148901:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:2411:x1876716432718848:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789776542.150382:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:2411:x1876716432718848:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 1337us (4401us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789776542.150399:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:3.0:1789776542.150417:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a5cff498000 x1876716432718848/t4294967309(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:733/0 lens 504/448 e 0 to 0 dl 1789776553 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776542.150429:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff498000 with x1876716432718848 ext(0->12) 00002000:00010000:3.0:1789776542.150437:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff498000 00000100:00100000:0.0:1789776542.154677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.154833:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432718976 00000100:00100000:2.0:1789776542.154843:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432718976 00000100:00100000:2.0:1789776542.155047:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:2.0:1789776542.155069:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:11403:x1876716432718976:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789776542.157828:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789776542.157850:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789776542.157986:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789776542.158038:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5ce02d9780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789776542.158046:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc10b9d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5ce02d9e40 00000020:00080000:3.0:1789776542.158079:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc10b9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc2682000 00000004:00080000:3.0:1789776542.158114:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1789776542.158189:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449557632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789776542.158280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776542.158395:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.158403:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449557632 00000100:00100000:1.0:1789776542.158413:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449557632 00010000:00010000:0.0:1789776542.158418:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158430:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158439:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.158458:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158469:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.158535:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789776542.158548:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449557632:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789776542.158554:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a5bc1a87600) 00010000:00010000:0.0:1789776542.158560:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.158567:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158575:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb884fed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789776542.158583:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1789776542.158612:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158623:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776542.158624:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd29d, atime: 0x6aadd29d, ctime: 0x6aadd29d, blocks: 0x8 00010000:00010000:0.0:1789776542.158648:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158651:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158660:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fe00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.158666:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158688:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1789776542.158706:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776542.158707:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158735:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158736:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a5cf512d600) 00010000:00010000:0.0:1789776542.158742:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.158756:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158761:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158764:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb885095 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158801:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158815:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158816:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158845:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158853:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158862:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.158868:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158893:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.158898:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776542.158905:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:0.0:1789776542.158910:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.158913:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158920:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885113 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158931:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158950:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158956:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158964:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.158968:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158975:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158985:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5bc1a87200) 00010000:00010000:0.0:1789776542.158989:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.158992:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.158998:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885136 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159022:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159028:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159034:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159039:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.159048:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159056:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159070:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776542.159073:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.159081:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.159082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449557632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 530us (795us total) trans 4294967305 rc 0/0 00010000:00010000:0.0:1789776542.159106:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb885208 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.159112:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1789776542.159147:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159153:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776542.159156:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159162:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159167:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159197:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ee00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.159203:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776542.159204:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159215:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.159218:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159243:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159263:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159271:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023480e05/0xf13b8042cb8852ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.159291:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776542.159293:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776542.159294:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789776542.159303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789776542.159337:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5bc3479c00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789776542.159351:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449557632:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789776542.161394:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:0.0:1789776542.161399:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776542.161431:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.161441:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8852c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.161575:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449557760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789776542.161681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776542.161792:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449557760 00000100:00100000:0.0:1789776542.161802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449557760 00000100:00100000:0.0:1789776542.161876:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789776542.161887:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449557760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789776542.161925:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789776542.161955:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.161980:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.161990:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789776542.161995:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776542.162001:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.162034:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.162063:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 11 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.162077:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1876716449557888:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776542.162193:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05c00 going to sleep for 11 seconds 00000100:00080000:0.0:1789776542.162209:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776542.162482:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449558016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789776542.162535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789776542.162604:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5cc9329600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789776542.162610:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc10b9300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cc9329c00 00000020:00080000:3.0:1789776542.162614:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc10b9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc33fe400 00000020:00080000:3.0:1789776542.162629:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789776542.162985:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449558016 00000100:00100000:1.0:1789776542.162993:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449558016 00000020:00080000:3.0:1789776542.163080:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1789776542.163150:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000020:00080000:3.0:1789776542.163187:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789776542.163248:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449558016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789776542.163602:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789776542.163606:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789776543 00002000:00010000:1.0:1789776542.163608:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789776542.163610:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789776543 -> 1789776543 00002000:00010000:1.0:1789776542.163613:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789776542.163963:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1876716449558016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 802us (1425us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789776542.163975:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789776542.164115:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cff49ed80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789776542.164136:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449558016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789776542.164804:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11403:x1876716432718976:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 9740us (10131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.164816:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:2.0:1789776542.168922:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1876716449557888:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776542.168970:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.168995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.169116:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432719104 00000100:00100000:3.0:1789776542.169125:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432719104 00010000:00010000:3.0:1789776542.169163:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 12 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776542.169207:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1789776542.169216:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:2412:x1876716432719104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776542.169231:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776542.169236:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 12 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.169250:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 12 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.169273:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe13040/0xf13b8042cb8850a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab587d expref: 12 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.169302:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776542.169307:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776542.169313:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.169324:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.169351:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776542.169400:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432719104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 185us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776542.169408:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00010000:00010000:2.0:1789776542.169460:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.169473:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.169487:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.169533:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.169676:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776542.170135:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776542.170144:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.170154:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776542.170158:0:7925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.170170:0:7925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.170183:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.170207:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f38ecc8/0xf13b8042cb8852f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.170225:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776542.170226:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776542.170228:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776542.171572:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1876716449557760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9681us (9885us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789776542.171637:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1789776542.171638:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cff49e300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789776542.171649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449557760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789776542.171931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.172140:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432719232 00000100:00100000:1.0:1789776542.172148:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432719232 00000100:00100000:1.0:1789776542.172202:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1789776542.172212:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432719232:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789776542.174706:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1789776542.174737:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789776542.175289:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432719232:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 3071us (3353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.175300:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1789776542.185459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.185613:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432719488 00000100:00100000:1.0:1789776542.185641:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432719488 00000100:00100000:1.0:1789776542.185706:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1789776542.185727:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11403:x1876716432719488:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.185782:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776542.185827:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8852da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5917 expref: 16 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.185851:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.185856:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776542.185891:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.185906:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.185916:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776542.186036:0:10345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd4489a9 reply state 00000000d0742694 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.186051:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.186058:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.186061:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776542.186063:0:10345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776542.186175:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:11403:x1876716432719488:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 449us (1356us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789776542.186183:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:0.0:1789776542.191259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.191346:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432719616 00000100:00100000:1.0:1789776542.191356:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432719616 00000100:00100000:1.0:1789776542.191464:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1789776542.191476:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432719616:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789776542.191684:0:8528:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789776542.191689:0:8528:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789776543 -> 1789776542 00002000:00010000:1.0:1789776542.191691:0:8528:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789776541 00002000:00010000:1.0:1789776542.191694:0:8528:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789776543 -> 1789776542 00002000:00010000:1.0:1789776542.191696:0:8528:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789776542.191764:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432719616:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 291us (515us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789776542.191773:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776542.200427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.201312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432719872 00000100:00100000:0.0:1789776542.201322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432719872 00000100:00100000:0.0:1789776542.201442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1789776542.201453:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:11403:x1876716432719872:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789776542.201547:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.201564:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 17 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.201584:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.201620:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 17 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.201635:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 17 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.201671:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449558144:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776542.201780:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776542.205100:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449558144:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776542.205136:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.206101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.206251:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720000 00000100:00100000:3.0:1789776542.206261:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720000 00010000:00010000:3.0:1789776542.206299:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 18 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776542.206341:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1789776542.206352:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+18:2411:x1876716432720000:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776542.206370:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776542.206376:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 18 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206389:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 18 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206409:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8852be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5909 expref: 18 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206427:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:3.0:1789776542.206433:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206459:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206466:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.206548:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776542.207128:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207138:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207257:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207266:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207274:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207289:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.207294:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207302:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207314:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.207317:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789776542.207323:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.207329:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885304 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.207870:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2411:x1876716432720000:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1514us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.207880:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:1.0:1789776542.208146:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11403:x1876716432719872:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 6694us (7728us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789776542.208156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1789776542.214466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.214795:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720128 00000100:00100000:3.0:1789776542.214807:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720128 00000100:00100000:3.0:1789776542.214911:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1789776542.214922:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432720128:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789776542.214965:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.214986:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.214995:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776542.214999:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776542.215004:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.215036:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.215050:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 7 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776542.215084:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449558272:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776542.215168:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667780 going to sleep for 11 seconds 00000100:00100000:3.0:1789776542.221123:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449558272:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776542.221123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00010000:00010000:3.0:1789776542.221156:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.221831:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720256 00000100:00100000:1.0:1789776542.221841:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720256 00010000:00010000:1.0:1789776542.221885:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 8 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.221917:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:1.0:1789776542.221926:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432720256:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776542.221941:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776542.221962:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 8 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.221998:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 8 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.222022:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac4ea470/0xf13b8042cb8852e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5925 expref: 8 pid: 8432 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.222039:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776542.222044:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776542.222050:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.222291:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.222400:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776542.222469:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432720256:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 543us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776542.222479:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00010000:00010000:3.0:1789776542.223996:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224013:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224043:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224118:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224129:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224137:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776542.224141:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224241:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224266:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.224275:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ff5d8b5/0xf13b8042cb88530b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.224469:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432720128:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 9535us (9999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.224480:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1789776542.230219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.230700:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720512 00000100:00100000:1.0:1789776542.230721:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720512 00000100:00100000:1.0:1789776542.230793:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1789776542.230803:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:11403:x1876716432720512:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.230984:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.231003:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 16 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.231044:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.231085:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 16 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.231100:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 16 pid: 10345 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.231113:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558400:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776542.231393:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc34263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776542.240687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.240823:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558400:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776542.240853:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.240899:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720640 00000100:00100000:2.0:1789776542.240906:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720640 00010000:00010000:2.0:1789776542.240944:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 17 pid: 10345 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.240987:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1789776542.240997:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2412:x1876716432720640:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776542.241011:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776542.241018:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 17 pid: 10345 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241030:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 17 pid: 10345 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241053:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58d1 expref: 17 pid: 10345 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241069:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776542.241076:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241098:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241106:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241113:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.241155:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776542.241210:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:2412:x1876716432720640:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 213us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.241217:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00010000:00010000:3.0:1789776542.241443:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.241451:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.241905:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.241918:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.241925:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.241952:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.241964:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 16 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.241977:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558528:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776542.242045:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776542.246914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.246950:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720768 00000100:00100000:2.0:1789776542.246960:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720768 00000100:00100000:1.0:1789776542.246989:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558528:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776542.247010:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.247016:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.247143:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1789776542.247198:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2412:x1876716432720768:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776542.247214:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776542.247222:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247235:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247279:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb8852cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5910 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247297:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:2.0:1789776542.247303:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247313:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247321:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.247350:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776542.247449:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.247457:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776542.247591:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1789776542.247628:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2412:x1876716432720768:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 408us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.247636:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000001:00080000:1.0:1789776542.247870:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789776542.247946:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789776542.248028:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13443:1876716449558656:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789776542.248118:0:13443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776542.248206:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776542.248706:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449558656 00000100:00100000:3.0:1789776542.248724:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449558656 00000100:00100000:0.0:1789776542.248870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789776542.248941:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13443:x1876716449558656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789776542.249097:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13443:x1876716449558656:12345-0@lo:1000:mdt00_004.0 Request processed in 218us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.249104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789776542.250673:0:13443:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789776542.250682:0:13443:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1789776542.250703:0:13443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cff49ed80, transno 4294967310 00000004:00080000:1.0:1789776542.250768:0:13443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cff49e300, transno 4294967311 00000100:00100000:1.0:1789776542.250935:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13443:1876716449558656:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789776542.252301:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789776542.252896:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13443:1876716449558784:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789776542.252979:0:13443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776542.253061:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776542.253106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449558784 00000100:00100000:2.0:1789776542.253113:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449558784 00000100:00100000:2.0:1789776542.253418:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789776542.253428:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13443:x1876716449558784:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789776542.253603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13443:x1876716449558784:12345-0@lo:1000:mdt00_004.0 Request processed in 177us (624us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789776542.253611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789776542.253704:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13443:1876716449558784:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789776542.253759:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253770:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253777:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253782:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.253787:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253795:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253830:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:1.0:1789776542.253833:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776542.253838:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253844:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb885319 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253869:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253875:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253881:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253886:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.253888:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253894:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253901:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.253904:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776542.253911:0:13443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253921:0:13443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253936:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.253967:0:13443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.253979:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558912:192.168.204.27@tcp:105: 00000100:00100000:1.0:1789776542.254051:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776542.256811:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff482680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449558912:192.168.204.27@tcp:105: 00010000:00010000:1.0:1789776542.256851:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256862:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88525c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256896:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256910:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256920:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256931:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256937:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256969:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256975:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.256980:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256987:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.256998:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.257001:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776542.257005:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257010:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885320 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257020:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257026:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257031:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257036:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.257039:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257054:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257063:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.257065:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776542.257068:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.257074:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885312 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.257758:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:11403:x1876716432720512:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 26953us (27547us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789776542.257768:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000020:00080000:1.0:1789776542.257774:0:13443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789776542.258422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.258854:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432720896 00000100:00100000:0.0:1789776542.258863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432720896 00000100:00100000:0.0:1789776542.258917:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1789776542.258927:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:11402:x1876716432720896:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:0.0:1789776542.259049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:11402:x1876716432720896:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 124us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.259056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1789776542.264488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.264631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776542.264780:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432721152 00000100:00100000:3.0:1789776542.264791:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432721152 00000100:00100000:1.0:1789776542.264803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432721408 00000100:00100000:1.0:1789776542.264810:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432721408 00000100:00100000:1.0:1789776542.264849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1789776542.264862:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:1.0:1789776542.264864:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11403:x1876716432721408:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789776542.264877:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:11402:x1876716432721152:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:3.0:1789776542.265035:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789776542.265128:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11402:x1876716432721152:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 255us (649us total) trans 0 rc 0/0 00000004:00080000:1.0:1789776542.265129:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1789776542.265140:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000001:00080000:1.0:1789776542.265169:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789776542.265224:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265243:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265254:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265273:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265279:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265284:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.265303:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789776542.265361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11403:x1876716432721408:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 503us (730us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789776542.265368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000020:00080000:1.0:1789776542.265372:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776542.265428:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776542.265437:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.265446:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776542.265451:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.265460:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.265474:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:3.0:1789776542.265478:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789776542.265483:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776542.265489:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885327 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776542.265569:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776542.265575:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1789776542.265594:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776542.265597:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776542.265597:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00010000:00010000:3.0:1789776542.265600:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776542.265609:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776542.265707:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449559040:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776542.265783:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce0162300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776542.273347:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449559040:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776542.275398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.275603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432721536 00000100:00100000:0.0:1789776542.275612:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432721536 00000100:00100000:0.0:1789776542.275726:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:0.0:1789776542.275879:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11404:x1876716432721536:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789776542.276028:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789776542.276256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11404:x1876716432721536:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 380us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.276264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1789776542.280280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.280686:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432721792 00000100:00100000:1.0:1789776542.280696:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432721792 00000100:00100000:1.0:1789776542.280765:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:1.0:1789776542.280776:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:11404:x1876716432721792:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.280797:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776542.280819:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88532e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab592c expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.280925:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.280941:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.280971:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776542.280985:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776542.281095:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88532e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab592c expref: 24 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.281228:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab592c expref: 23 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.281237:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.281240:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789776542.281244:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0800, rc 0) 00000100:00100000:1.0:1789776542.281310:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:11404:x1876716432721792:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 536us (1039us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789776542.281318:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1789776542.286748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.286905:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432722048 00000100:00100000:1.0:1789776542.286915:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432722048 00000100:00100000:1.0:1789776542.286971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:1.0:1789776542.286980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:11404:x1876716432722048:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789776542.287283:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287303:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287314:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287484:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287565:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287574:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287580:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776542.287585:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287593:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287605:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776542.287608:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776542.287613:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776542.287619:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885343 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.287867:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:11404:x1876716432722048:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 885us (1128us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789776542.287887:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000040:00080000:2.0:1789776542.288267:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776542.288273:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776542.290417:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789776542.290447:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776542.292940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.297101:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432722304 00000100:00100000:1.0:1789776542.297117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432722304 00000100:00100000:0.0:1789776542.299397:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1789776542.299412:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:11404:x1876716432722304:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776542.299673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:11404:x1876716432722304:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 264us (6963us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789776542.299699:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1789776542.310060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776542.310338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432722432 00000100:00100000:0.0:1789776542.310349:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432722432 00000100:00100000:0.0:1789776542.310486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:0.0:1789776542.310528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:11406:x1876716432722432:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776542.310553:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776542.310573:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb88534a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5933 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310636:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310651:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310663:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310695:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310701:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310718:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310792:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310832:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 26 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310844:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310881:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 26 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.310895:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 26 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776542.310909:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449559168:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776542.311005:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776542.317960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776542.318072:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432722688 00000100:00100000:1.0:1789776542.318094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432722688 00000100:00100000:1.0:1789776542.318160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1789776542.318279:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:6179:x1876716432722688:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789776542.318631:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:6179:x1876716432722688:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 459us (679us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789776542.318639:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1789776542.318775:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449559168:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776542.318803:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776542.322267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776542.322394:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432722816 00000100:00100000:2.0:1789776542.322405:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432722816 00010000:00010000:2.0:1789776542.322445:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 28 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776542.322489:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:2.0:1789776542.322543:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:2411:x1876716432722816:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776542.322559:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776542.322567:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 28 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322581:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 28 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322602:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88524e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58ed expref: 28 pid: 13443 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322637:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:2.0:1789776542.322642:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322652:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322660:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776542.322686:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776542.322749:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:2411:x1876716432722816:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 209us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776542.322757:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00010000:00010000:0.0:1789776542.322891:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.322900:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776542.322952:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789776542.322957:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776542.322976:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323000:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323010:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323017:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323024:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323030:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.323035:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323043:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323053:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:0.0:1789776542.323055:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.323059:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323066:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885351 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323077:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323083:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323094:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323099:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776542.323102:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323205:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323213:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a5cf512d600) 00010000:00010000:0.0:1789776542.323215:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776542.323219:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323224:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885358 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323260:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb88534a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5933 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323275:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5933 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776542.323282:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:0.0:1789776542.323284:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776542.323287:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f8400, rc 0) 00000100:00100000:0.0:1789776542.323317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:11406:x1876716432722432:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 12822us (13268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776542.323332:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000040:00080000:3.0:1789776543.107262:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776543.107270:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776543.107317:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789776543.107325:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789776543.141539:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776543.266712:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776543.266737:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776543.266808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776543.266985:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559296 00000100:00100000:3.0:1789776543.266993:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559296 00000100:00100000:3.0:1789776543.267137:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789776543.267156:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449559296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776543.267180:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789776543.267237:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449559296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776543.267245:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789776543.267317:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776543.268236:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449559424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776543.268277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776543.268341:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559424 00000100:00100000:3.0:1789776543.268347:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559424 00000100:00100000:3.0:1789776543.268398:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789776543.268406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449559424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776543.268423:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00080000:1.0:1789776543.268517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776543.268664:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449559424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776543.268672:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789776543.268742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449559424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776543.271151:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776543.271235:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723072 00000100:00100000:1.0:1789776543.271245:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723072 00000100:00100000:1.0:1789776543.271424:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:1.0:1789776543.271434:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:11430:x1876716432723072:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776543.271462:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789776543.271464:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776543.271483:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab593a expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.271671:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb88536d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.271687:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb88536d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.271711:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb88536d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776543.271723:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776543.271835:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab593a expref: 29 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.271989:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb88536d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab593a expref: 28 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.271998:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776543.272001:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789776543.272004:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1600, rc 0) 00000100:00100000:1.0:1789776543.272069:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:11430:x1876716432723072:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 636us (925us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789776543.272076:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:3.0:1789776543.274179:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776543.274302:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723200 00000100:00100000:1.0:1789776543.274312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723200 00000100:00100000:1.0:1789776543.274375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:1.0:1789776543.274385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:11430:x1876716432723200:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1789776543.274451:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274467:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274479:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274606:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274613:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274638:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274644:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776543.274718:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274728:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274740:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:1.0:1789776543.274808:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776543.274813:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776543.274820:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88537b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776543.274941:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:11430:x1876716432723200:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 556us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776543.274949:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:3.0:1789776543.381647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776543.381864:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723328 00000100:00100000:2.0:1789776543.381873:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723328 00000100:00100000:2.0:1789776543.381937:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1789776543.381953:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd885f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2414:x1876716432723328:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1789776543.381973:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776543.381994:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885382 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5941 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776543.382035:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd29e, atime: 0x6aadd29d, ctime: 0x6aadd29e, blocks: 0x8 00010000:00010000:2.0:1789776543.382055:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1789776543.382060:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776543.382070:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5941 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776543.382091:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5941 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776543.382105:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2600, rc 0) 00000100:00100000:2.0:1789776543.382166:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd885f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2414:x1876716432723328:12345-192.168.204.27@tcp:101:cat.0 Request processed in 220us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.382174:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:3.0:1789776543.386987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776543.388640:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723456 00000100:00100000:1.0:1789776543.388654:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723456 00002000:00100000:1.0:1789776543.388725:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8a5cff466680 x1876716432723456/t0(0) o3->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:734/0 lens 488/0 e 0 to 0 dl 1789776554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776543.388737:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff466680 with x1876716432723456 ext(0->4095) 00002000:00010000:1.0:1789776543.388743:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff466680 00000100:00100000:1.0:1789776543.388784:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1789776543.388795:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432723456:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:1.0:1789776543.389594:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432723456:12345-192.168.204.27@tcp:3:cat.0 Request processed in 795us (2612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789776543.389604:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00002000:00100000:1.0:1789776543.389612:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8a5cff466680 x1876716432723456/t0(0) o3->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:734/0 lens 488/4536 e 0 to 0 dl 1789776554 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776543.389632:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff466680 with x1876716432723456 ext(0->4095) 00002000:00010000:1.0:1789776543.389636:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff466680 00000100:00100000:3.0:1789776543.778903:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449559552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776543.779012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776543.779064:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559552 00000100:00100000:2.0:1789776543.779072:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559552 00000100:00100000:3.0:1789776543.779086:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776543.779093:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449559680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776543.779115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776543.779434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449560192:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779558:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc34b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449559808:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.779626:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449560320:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.779668:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449560832:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.779724:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789776543.779730:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449559936:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.779772:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449560448:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.779809:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449560960:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.779828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776543.780060:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560832 00000100:00100000:0.0:1789776543.780065:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560832 00000100:00100000:0.0:1789776543.780103:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776543.780113:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449560832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.780163:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449560832:12345-0@lo:400:kworker.0 Request processed in 51us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776543.780170:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776543.780192:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559936 00000100:00100000:0.0:1789776543.780196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559936 00000100:00100000:0.0:1789776543.780219:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560448 00000100:00100000:0.0:1789776543.780232:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560448 00000100:00100000:0.0:1789776543.780261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560960 00000100:00100000:0.0:1789776543.780264:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560960 00000100:00100000:0.0:1789776543.780278:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789776543.780284:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449559936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.780313:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449559936:12345-0@lo:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776543.780318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789776543.780330:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789776543.780336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449560448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.780358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449560448:12345-0@lo:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776543.780363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789776543.780372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789776543.780377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449560960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.780397:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449560960:12345-0@lo:400:kworker.0 Request processed in 20us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776543.780403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1789776543.780418:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776543.781088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776543.781118:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449560704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.781142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776543.781164:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789776543.781171:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449560064:0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.781934:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559680 00000100:00100000:2.0:1789776543.781942:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559680 00000100:00100000:2.0:1789776543.781988:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789776543.781997:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876716449559552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776543.782046:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776543.782098:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876716449559552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.782105:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789776543.782121:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789776543.782127:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449559680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776543.782150:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776543.782176:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449559680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.782183:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789776543.782208:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560320 00000100:00100000:2.0:1789776543.782212:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560320 00000100:00100000:2.0:1789776543.782240:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789776543.782246:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.782282:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449560320:12345-0@lo:400:kworker.0 Request processed in 36us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.782289:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789776543.782295:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560192 00000100:00100000:3.0:1789776543.782301:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560192 00000100:00100000:2.0:1789776543.782312:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560704 00000100:00100000:2.0:1789776543.782318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560704 00000100:00100000:3.0:1789776543.782335:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789776543.782345:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.782364:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776543.782372:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449560704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.782402:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449560704:12345-0@lo:400:kworker.0 Request processed in 32us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.782408:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789776543.782511:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449560192:12345-0@lo:400:kworker.0 Request processed in 169us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776543.782518:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789776543.782572:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449559680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776543.782591:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cc815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449559552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776543.782643:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449559936:0@lo:400:kworker.0 00000100:00100000:3.0:1789776543.782646:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449559808 00000100:00100000:3.0:1789776543.782653:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449559808 00000100:00100000:0.0:1789776543.782665:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449560448:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.782678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449560960:0@lo:400:kworker.0 00000100:00100000:3.0:1789776543.783309:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789776543.783321:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449559808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776543.783378:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449559808:12345-0@lo:400:kworker.0 Request processed in 60us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776543.783385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:3.0:1789776543.783425:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776543.785055:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc34b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449559808:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.785072:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449560320:0@lo:400:kworker.0 00000100:00100000:0.0:1789776543.785109:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449560832:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.785256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776543.785297:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.785330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776543.785429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449561088:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.785465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776543.787530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560064 00000100:00100000:2.0:1789776543.787545:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560064 00000100:00100000:2.0:1789776543.787610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789776543.787623:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449560064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.787879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449560064:12345-0@lo:400:kworker.0 Request processed in 258us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.787888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789776543.792244:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.792263:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449560704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776543.792294:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449560064:0@lo:400:kworker.0 00000100:00100000:3.0:1789776543.793877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449560576 00000100:00100000:3.0:1789776543.793890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449560576 00000100:00100000:2.0:1789776543.793921:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561088 00000100:00100000:2.0:1789776543.793929:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561088 00000100:00100000:3.0:1789776543.793984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789776543.793995:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449560576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789776543.794082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776543.794098:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789776543.794107:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449561088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776543.794192:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449561088:12345-0@lo:400:kworker.0 Request processed in 86us (8726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.794201:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:0.0:1789776543.794233:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf5e0a300 x1876716449560576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776543.794247:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449560576:0@lo:400:kworker.0 00010000:00080000:0.0:1789776543.794260:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3edca80 x1876716449561088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776543.794269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449561088:0@lo:400:kworker.0 00000100:00100000:3.0:1789776543.794343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449560576:12345-0@lo:400:kworker.0 Request processed in 350us (9012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776543.794351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00010000:0.0:1789776544.164101:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776544.445747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776544.445788:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776544.445904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776544.445934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776544.447384:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723584 00000100:00100000:2.0:1789776544.447397:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723584 00000100:00100000:2.0:1789776544.447454:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 379 00000100:00100000:2.0:1789776544.447464:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432723584:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776544.447564:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432723584:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 101us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776544.447572:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 379 00000100:00100000:2.0:1789776544.448033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724096 00000100:00100000:2.0:1789776544.448039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724096 00000100:00100000:2.0:1789776544.448080:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1789776544.448087:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432724096:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776544.448119:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432724096:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776544.448126:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00080000:2.0:1789776544.448142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776544.449018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776544.449050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776544.449272:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723840 00000100:00100000:1.0:1789776544.449281:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723840 00000100:00100000:1.0:1789776544.449335:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723712 00000100:00100000:1.0:1789776544.449339:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723712 00000100:00100000:1.0:1789776544.449373:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 275 00000100:00100000:1.0:1789776544.449382:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432723840:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776544.449438:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432723840:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776544.449445:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 275 00000100:00100000:1.0:1789776544.449460:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00100000:1.0:1789776544.449468:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:2411:x1876716432723712:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776544.449514:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:2411:x1876716432723712:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776544.449520:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 276 00000100:00080000:1.0:1789776544.449538:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776544.450197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776544.450230:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432723968 00000100:00100000:3.0:1789776544.450237:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432723968 00000100:00100000:3.0:1789776544.450277:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1789776544.450286:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432723968:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776544.450327:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432723968:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.450334:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1789776544.450352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724224 00000100:00100000:3.0:1789776544.450355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724224 00000100:00100000:3.0:1789776544.450518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724352 00000100:00100000:3.0:1789776544.450522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724352 00000100:00100000:3.0:1789776544.450538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:3.0:1789776544.450544:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432724224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776544.450573:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432724224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.450580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 277 00000100:00100000:3.0:1789776544.450592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:3.0:1789776544.450598:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432724352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776544.450619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432724352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.450625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00080000:3.0:1789776544.450987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776544.450991:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776544.450994:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789776545.186753:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776546.214865:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776546.851572:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776546.851593:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449561216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776546.851670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776546.851743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561216 00000100:00100000:3.0:1789776546.851750:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561216 00000100:00100000:3.0:1789776546.851791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789776546.851800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449561216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776546.851831:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776546.851951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449561344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776546.851987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776546.852013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561344 00000100:00100000:2.0:1789776546.852020:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561344 00000100:00100000:3.0:1789776546.853176:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449561216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1372us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.853187:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789776546.853221:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789776546.853233:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449561344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776546.853261:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789776546.853299:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449561344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.853304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789776546.857409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449561216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776546.857516:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449561344:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789776546.865596:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789776546.865615:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1789776547.234673:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776547.429317:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776547.429330:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776547.429351:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789776547.429358:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789776547.876284:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1789776547.883288:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789776547.883319:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789776547.895038:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789776547.895070:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5cc9329c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789776547.895075:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cf50fa800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cc9329840 00000020:00080000:0.0:1789776547.895080:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cf50fab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc23eba00 00000020:00080000:0.0:1789776547.895100:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789776547.895163:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789776547.895224:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789776547.895268:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895281:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895289:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895295:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776547.895301:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895309:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895327:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a5bc1a87300) 00010000:00010000:2.0:1789776547.895330:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776547.895334:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.895341:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8852fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.264999:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776548.386838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776548.386910:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776548.387072:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776548.387082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449561600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776548.387117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776548.387204:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561472 00000100:00100000:2.0:1789776548.387212:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561472 00000100:00100000:2.0:1789776548.387281:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561600 00000100:00100000:2.0:1789776548.387285:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561600 00000100:00100000:2.0:1789776548.387305:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789776548.387359:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449561472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776548.387389:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789776548.387453:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449561472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (542us total) trans 0 rc 0/0 00000100:00080000:1.0:1789776548.387511:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776548.402140:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789776548.402170:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449561600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776548.402211:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789776548.402309:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449561600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (15191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.402317:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789776548.402413:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789776548.402420:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789776548.402452:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776548.405189:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449561600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776548.408263:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789776548.427119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776548.429133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724480 00000100:00100000:0.0:1789776548.429154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724480 00000100:00100000:1.0:1789776548.433962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:1.0:1789776548.434005:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11083:x1876716432724480:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789776548.434188:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11083:x1876716432724480:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 191us (7085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776548.434197:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00080000:3.0:1789776548.434528:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776548.436553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776548.440227:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724608 00000100:00100000:2.0:1789776548.440253:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724608 00000100:00100000:2.0:1789776548.440390:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:2.0:1789776548.440408:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:11083:x1876716432724608:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789776548.440607:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:11083:x1876716432724608:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 205us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.440617:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00080000:3.0:1789776548.441219:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776548.443868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776548.446983:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724864 00000100:00100000:1.0:1789776548.447004:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724864 00000100:00100000:1.0:1789776548.447125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1789776548.447140:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:11083:x1876716432724864:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789776548.447657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:11083:x1876716432724864:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 510us (3793us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789776548.447670:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1789776548.789989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776548.790166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432724992 00000100:00100000:3.0:1789776548.790179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432724992 00000100:00100000:3.0:1789776548.790290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:3.0:1789776548.790304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:11889:x1876716432724992:12345-192.168.204.27@tcp:101:lsof.0 00010000:00010000:3.0:1789776548.790333:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776548.790360:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5948 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.790444:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.790475:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.790547:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776548.790622:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776548.790627:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776548.790675:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.790997:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.791042:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.791051:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:3.0:1789776548.791054:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776548.791058:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342da00, rc 0) 00000100:00100000:3.0:1789776548.791143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:11889:x1876716432724992:12345-192.168.204.27@tcp:101:lsof.0 Request processed in 841us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.791150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00080000:1.0:1789776548.792725:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776548.902601:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776548.902635:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449561728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776548.902745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776548.902928:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449561856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776548.903705:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449562240:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.903795:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449562752:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.903841:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449563264:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.903894:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789776548.903900:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449562112:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.903940:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449562624:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.903973:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449563136:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.903994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776548.904031:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562240 00000100:00100000:0.0:1789776548.904040:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562240 00000100:00100000:0.0:1789776548.904098:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789776548.904109:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449562240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904176:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449562240:12345-0@lo:400:kworker.0 Request processed in 68us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904184:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789776548.904215:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562752 00000100:00100000:0.0:1789776548.904218:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562752 00000100:00100000:0.0:1789776548.904253:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563264 00000100:00100000:0.0:1789776548.904256:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563264 00000100:00100000:0.0:1789776548.904272:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562112 00000100:00100000:0.0:1789776548.904274:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562112 00000100:00100000:0.0:1789776548.904302:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562624 00000100:00100000:0.0:1789776548.904306:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562624 00000100:00100000:0.0:1789776548.904320:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563136 00000100:00100000:0.0:1789776548.904323:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563136 00000100:00100000:0.0:1789776548.904350:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789776548.904357:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449562752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904392:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449562752:12345-0@lo:400:kworker.0 Request processed in 35us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904398:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789776548.904411:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789776548.904417:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904445:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449563264:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904451:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789776548.904462:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789776548.904468:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904523:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449562112:12345-0@lo:400:kworker.0 Request processed in 55us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904529:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789776548.904542:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789776548.904547:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904574:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449562624:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904590:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789776548.904602:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789776548.904607:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904633:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449563136:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.904639:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789776548.904715:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449562112:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904728:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449562624:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904737:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449563136:0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.904746:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449562240:0@lo:400:kworker.0 00010000:00080000:0.0:1789776548.904758:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3e94a80 x1876716449562752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776548.904770:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449562752:0@lo:400:kworker.0 00010000:00080000:0.0:1789776548.904781:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3e96d80 x1876716449563264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776548.904789:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789776548.905421:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905488:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449561984:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905652:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905704:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449563008:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905779:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789776548.905786:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905835:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449562880:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905878:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449563392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.905918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776548.905955:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562496 00000100:00100000:3.0:1789776548.905963:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562496 00000100:00100000:3.0:1789776548.906008:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789776548.906016:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906068:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449562496:12345-0@lo:400:kworker.0 Request processed in 53us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.906075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789776548.906097:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563008 00000100:00100000:3.0:1789776548.906101:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563008 00000100:00100000:3.0:1789776548.906127:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562880 00000100:00100000:3.0:1789776548.906129:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562880 00000100:00100000:3.0:1789776548.906140:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563392 00000100:00100000:3.0:1789776548.906142:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563392 00000100:00100000:3.0:1789776548.906160:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789776548.906167:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449563008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906199:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449563008:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.906205:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789776548.906216:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789776548.906222:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449562880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906249:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449562880:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.906254:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789776548.906264:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789776548.906270:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449563392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906307:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449563392:12345-0@lo:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.906320:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789776548.906354:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449562368 00000100:00100000:3.0:1789776548.906358:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449562368 00000100:00100000:3.0:1789776548.906381:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789776548.906387:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449562368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906420:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449562368:12345-0@lo:400:kworker.0 Request processed in 33us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.906425:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789776548.906464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906474:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449562880:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906482:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789776548.906489:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789776548.906544:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5bc3479c00, transno 4294967305 00000100:00100000:3.0:1789776548.906559:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449563392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906572:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789776548.906594:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449563008:0@lo:400:kworker.0 00000100:00080000:3.0:1789776548.906666:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776548.906672:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776548.906675:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776548.911382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561984 00000100:00100000:0.0:1789776548.911404:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561984 00000100:00100000:0.0:1789776548.911546:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789776548.911560:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449561984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776548.911719:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449561984:12345-0@lo:400:kworker.0 Request processed in 161us (6134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.911728:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789776548.911820:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449561984:0@lo:400:kworker.0 00000100:00100000:2.0:1789776548.919049:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561728 00000100:00100000:2.0:1789776548.919073:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561728 00000100:00100000:2.0:1789776548.919407:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449561856 00000100:00100000:2.0:1789776548.919413:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449561856 00000100:00100000:2.0:1789776548.919442:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789776548.919453:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449561728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776548.919518:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776548.919650:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449561728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 199us (16905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.919659:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789776548.919733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449561728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776548.920214:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789776548.920227:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449561856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776548.920243:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776548.920430:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449561856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (15012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.920457:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789776548.924141:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776548.924267:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449561856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789776549.282832:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776549.563743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.563798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.563838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.563893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776549.564122:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725632 00000100:00100000:1.0:1789776549.564136:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725632 00000100:00100000:1.0:1789776549.564234:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:1.0:1789776549.564247:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432725632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776549.564367:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725120 00000100:00100000:2.0:1789776549.564373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725120 00000100:00100000:2.0:1789776549.564410:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 381 00000100:00100000:2.0:1789776549.564418:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432725120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776549.564546:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725376 00000100:00100000:0.0:1789776549.564552:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725376 00000100:00100000:0.0:1789776549.564600:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725888 00000100:00100000:0.0:1789776549.564604:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725888 00000100:00100000:0.0:1789776549.564629:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 285 00000100:00100000:0.0:1789776549.564637:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432725376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776549.565756:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432725632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1501us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.565772:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00080000:1.0:1789776549.565819:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776549.565841:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776549.565943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:1.0:1789776549.565955:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432725888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776549.566081:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432725888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 129us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.566089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:2.0:1789776549.571433:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cdb656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432725120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 6994us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776549.571462:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 381 00000100:00100000:3.0:1789776549.575631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.575801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.575884:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776549.575928:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725248 00000100:00100000:3.0:1789776549.575943:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725248 00000100:00100000:3.0:1789776549.576006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725760 00000100:00100000:3.0:1789776549.576009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725760 00000100:00100000:3.0:1789776549.576033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:3.0:1789776549.576046:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:2412:x1876716432725248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776549.576168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:2412:x1876716432725248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 125us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776549.576178:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 287 00000100:00100000:3.0:1789776549.576211:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:3.0:1789776549.576219:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432725760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776549.576247:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432725760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776549.576254:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:2.0:1789776549.577937:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432725504 00000100:00100000:2.0:1789776549.577954:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432725504 00000100:00100000:2.0:1789776549.578031:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:2.0:1789776549.578043:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432725504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776549.578131:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2412:x1876716432725504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 91us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776549.578138:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00080000:1.0:1789776549.578463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776549.589050:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432725376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21667us (22504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.589073:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 285 00010000:00010000:0.0:1789776550.319262:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776551.330781:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776551.973808:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449563648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776551.973948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776551.973969:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449563520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776551.974016:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776551.976572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563648 00000100:00100000:3.0:1789776551.976589:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563648 00000100:00100000:3.0:1789776551.976659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563520 00000100:00100000:3.0:1789776551.976663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563520 00000100:00100000:3.0:1789776551.976688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789776551.976701:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449563648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776551.976768:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776551.976883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449563648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776551.976899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789776551.976923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789776551.976930:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449563520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776551.976949:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789776551.976992:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449563520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776551.976999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789776551.977073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449563520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776551.978215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449563648:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789776552.244444:0:14504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:09:12 (1789776552) 00010000:00010000:0.0:1789776552.354718:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776553.368885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776553.369891:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726144 00000100:00100000:1.0:1789776553.369907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726144 00000100:00100000:1.0:1789776553.370480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1789776553.370526:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:12156:x1876716432726144:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776553.370556:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776553.370584:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885397 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab594f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370680:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370699:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370716:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370732:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370739:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370769:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370886:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8853ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370894:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8853ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.370902:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8853ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776553.370913:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789776553.371107:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371117:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371125:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371133:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776553.371138:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371149:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371164:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5cf512d500) 00010000:00010000:1.0:1789776553.371167:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776553.371179:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371187:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88539e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371203:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371210:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371216:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371222:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776553.371225:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371231:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371239:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a5cc3edea00) 00010000:00010000:1.0:1789776553.371247:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776553.371250:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.371255:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8853a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789776553.371296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776553.371994:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885397 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab594f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.372025:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8853ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab594f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776553.372034:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:1.0:1789776553.372037:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776553.372040:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776553.372555:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:12156:x1876716432726144:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 2060us (3680us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789776553.372565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:2.0:1789776553.376696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776553.377179:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726272 00000100:00100000:3.0:1789776553.377194:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726272 00000100:00100000:3.0:1789776553.377291:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1789776553.377307:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:2413:x1876716432726272:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776553.377330:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776553.377369:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8853ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab594f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776553.377401:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:3.0:1789776553.377418:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776553.377802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776553.378115:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:2413:x1876716432726272:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 811us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776553.378128:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00010000:00010000:2.0:1789776553.379735:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776553.379984:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789776553.380000:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789776553.380037:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789776553.380051:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789776553.380839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726400 00000100:00100000:1.0:1789776553.380854:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726400 00000100:00100000:1.0:1789776553.380992:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:1.0:1789776553.381006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:12156:x1876716432726400:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789776553.381168:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:12156:x1876716432726400:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 164us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.381177:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:2.0:1789776553.385611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776553.385716:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726528 00000100:00100000:0.0:1789776553.385730:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726528 00000100:00100000:0.0:1789776553.385824:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:0.0:1789776553.385846:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:12156:x1876716432726528:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789776553.385996:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:12156:x1876716432726528:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 155us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776553.386005:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00080000:2.0:1789776553.386074:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776553.507571:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449563776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776553.507593:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449563904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776553.507690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776553.507752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776553.507820:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563904 00000100:00100000:1.0:1789776553.507832:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563904 00000100:00100000:1.0:1789776553.507900:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449563776 00000100:00100000:1.0:1789776553.507904:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449563776 00000100:00100000:1.0:1789776553.507926:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789776553.507936:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449563904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776553.507975:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789776553.508045:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449563904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.508054:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789776553.508074:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789776553.508081:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449563776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776553.508092:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789776553.508123:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449563776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.508130:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789776553.508190:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449563904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776553.508267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449563776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789776553.510304:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789776553.571714:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776553.571735:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776553.573437:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789776553.573462:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789776554.019792:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776554.019991:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776554.020032:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449564032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776554.020143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776554.020204:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564032 00000100:00100000:2.0:1789776554.020215:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564032 00000100:00100000:2.0:1789776554.020368:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789776554.020383:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449564032:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789776554.020388:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789776554.020434:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776554.020636:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449564032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 257us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.020645:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789776554.020827:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449564032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776554.022714:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449564544:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.022825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776554.022908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449565056:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.022934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776554.022957:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449565568:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.022980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776554.023012:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789776554.023124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565056 00000100:00100000:1.0:1789776554.023134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565056 00000100:00100000:1.0:1789776554.023203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565568 00000100:00100000:1.0:1789776554.023207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565568 00000100:00100000:1.0:1789776554.023236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789776554.023246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.023312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449565056:12345-0@lo:400:kworker.0 Request processed in 67us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.023320:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789776554.023339:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789776554.023345:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449565568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.023394:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449565568:12345-0@lo:400:kworker.0 Request processed in 50us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.023401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789776554.024140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564544 00000100:00100000:2.0:1789776554.024150:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564544 00000100:00100000:2.0:1789776554.024200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776554.024209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449564544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.024274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449564544:12345-0@lo:400:kworker.0 Request processed in 66us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.024282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789776554.024409:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449564416:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.024466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776554.024538:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449564160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776554.024574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776554.024610:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449564672:0@lo:400:kworker.0 00000100:00100000:3.0:1789776554.024642:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449564288:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.024866:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564160 00000100:00100000:2.0:1789776554.024872:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564160 00000100:00100000:2.0:1789776554.024917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789776554.024924:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449564160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776554.024946:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789776554.024993:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449564160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.024999:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789776554.025607:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564416 00000100:00100000:1.0:1789776554.025614:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564416 00000100:00100000:3.0:1789776554.025921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776554.025966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449564800:0@lo:400:kworker.0 00000100:00100000:3.0:1789776554.025997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776554.026127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789776554.026138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449564416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.026194:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449564416:12345-0@lo:400:kworker.0 Request processed in 59us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.026201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789776554.026234:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564800 00000100:00100000:1.0:1789776554.026238:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564800 00000100:00100000:1.0:1789776554.026261:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789776554.026267:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449564800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.026300:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449564800:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.026306:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1789776554.026328:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776554.026335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776554.026532:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449564416:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.026542:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449564928:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.026573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776554.026589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449565440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.026613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776554.026641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449564544:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.026784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776554.026832:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449565184:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.026864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776554.026885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449565696:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.026904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776554.026945:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449564160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776554.026980:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565184 00000100:00100000:2.0:1789776554.026984:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565184 00000100:00100000:2.0:1789776554.027016:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565696 00000100:00100000:2.0:1789776554.027018:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565696 00000100:00100000:2.0:1789776554.027040:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789776554.027047:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449565184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027094:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449565184:12345-0@lo:400:kworker.0 Request processed in 48us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.027102:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789776554.027114:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789776554.027120:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449565696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027147:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449565696:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.027153:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789776554.027195:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449565184:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449565696:0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027223:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564928 00000100:00100000:2.0:1789776554.027227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564928 00000100:00100000:2.0:1789776554.027259:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565440 00000100:00100000:2.0:1789776554.027263:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565440 00000100:00100000:2.0:1789776554.027280:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564672 00000100:00100000:2.0:1789776554.027291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564672 00000100:00100000:2.0:1789776554.027308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789776554.027315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027347:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449564928:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.027353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789776554.027364:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789776554.027370:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449565440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449565440:12345-0@lo:400:kworker.0 Request processed in 26us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.027401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789776554.027412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789776554.027417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449564672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776554.027450:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449564672:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776554.027456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1789776554.027475:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776554.027530:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449564672:0@lo:400:kworker.0 00000100:00100000:3.0:1789776554.027611:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449565312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776554.027647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789776554.027788:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3d3c380 x1876716449565056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776554.027801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449565056:0@lo:400:kworker.0 00010000:00080000:0.0:1789776554.027818:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3d3fb80 x1876716449565568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776554.027826:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449565568:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.027858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449564928:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.027870:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449565440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.027929:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449564288 00000100:00100000:0.0:1789776554.027933:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449564288 00000100:00100000:0.0:1789776554.027964:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789776554.027971:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449564288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776554.028007:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449564288:12345-0@lo:400:kworker.0 Request processed in 37us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776554.028013:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789776554.028645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449564288:0@lo:400:kworker.0 00000100:00100000:3.0:1789776554.028749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449564800:0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.028961:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449565312 00000100:00100000:1.0:1789776554.028968:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449565312 00000100:00100000:1.0:1789776554.029016:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776554.029025:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449565312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776554.029082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449565312:12345-0@lo:400:kworker.0 Request processed in 58us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.029089:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789776554.033050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449565312:0@lo:400:kworker.0 00010000:00010000:3.0:1789776554.405460:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776554.687295:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.687536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726912 00000100:00100000:1.0:1789776554.687550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726912 00000100:00100000:1.0:1789776554.687613:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727424 00000100:00100000:1.0:1789776554.687617:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727424 00000100:00100000:1.0:1789776554.687646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726784 00000100:00100000:1.0:1789776554.687649:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726784 00000100:00100000:1.0:1789776554.687670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:1.0:1789776554.687683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432726912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776554.687785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432726912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 103us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.687796:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:3.0:1789776554.687801:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432726656 00000100:00100000:3.0:1789776554.687808:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432726656 00000100:00100000:1.0:1789776554.687818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:1.0:1789776554.687828:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432727424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776554.687852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:3.0:1789776554.687862:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432726656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776554.687874:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432727424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.687882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:1.0:1789776554.687898:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:3.0:1789776554.687901:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432726656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.687910:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:2411:x1876716432726784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776554.687916:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 383 00000100:00100000:1.0:1789776554.687947:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:2411:x1876716432726784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.687956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00080000:3.0:1789776554.687973:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776554.687990:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727168 00000100:00100000:1.0:1789776554.687995:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727168 00000100:00100000:1.0:1789776554.688033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727040 00000100:00080000:3.0:1789776554.688037:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776554.688037:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727040 00000100:00080000:3.0:1789776554.688054:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776554.688070:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:1.0:1789776554.688079:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432727168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776554.688084:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1789776554.688097:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432727040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776554.688127:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432727168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 48us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.688135:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:3.0:1789776554.688140:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432727040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 44us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776554.688149:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1789776554.691699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776554.692105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727296 00000100:00100000:1.0:1789776554.692119:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727296 00000100:00100000:1.0:1789776554.692224:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:1.0:1789776554.692237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2411:x1876716432727296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776554.692341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2411:x1876716432727296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 107us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776554.692350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00080000:3.0:1789776554.693018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776555.268587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776555.268750:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727552 00000100:00100000:3.0:1789776555.268760:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727552 00000100:00100000:3.0:1789776555.268842:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00100000:3.0:1789776555.268853:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:12198:x1876716432727552:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776555.268876:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776555.268900:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5956 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.268978:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.268995:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269008:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269024:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269031:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269051:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269096:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269104:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269112:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269118:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776555.269123:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269131:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269144:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:3.0:1789776555.269147:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776555.269151:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269158:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8853c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269171:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269178:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269190:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269195:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776555.269198:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269205:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269213:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a5bc33da600) 00010000:00010000:3.0:1789776555.269216:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776555.269219:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269225:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8853c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269257:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5956 expref: 15 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269268:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:3.0:1789776555.269270:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776555.269274:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5956 expref: 15 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.269284:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d400, rc 0) 00000100:00100000:3.0:1789776555.269344:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:12198:x1876716432727552:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 493us (768us total) trans 0 rc 301/301 00000100:00100000:3.0:1789776555.269359:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00080000:2.0:1789776555.270222:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776555.280322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776555.280404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727808 00000100:00100000:3.0:1789776555.280415:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727808 00000100:00100000:3.0:1789776555.280486:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:3.0:1789776555.280518:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+14:12198:x1876716432727808:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:3.0:1789776555.280581:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776555.280612:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb884d0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab577a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.280630:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:3.0:1789776555.280636:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776555.280697:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.280711:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.280720:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.280757:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.280772:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 5 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776555.280789:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449565824:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776555.280892:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc25819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776555.283632:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449565824:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776555.283666:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776555.287250:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.287368:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432727936 00000100:00100000:0.0:1789776555.287379:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432727936 00010000:00010000:0.0:1789776555.287425:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 6 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776555.287480:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1789776555.287519:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432727936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776555.287536:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776555.287544:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 6 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287558:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 6 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287582:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885390 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5948 expref: 6 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287599:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:0.0:1789776555.287605:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287616:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287635:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287661:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776555.287719:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432727936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 230us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.287728:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00010000:00010000:0.0:1789776555.287815:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287824:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287848:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287859:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.287867:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288476:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288489:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288521:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776555.288550:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c694b43c reply state 00000000d17cff05 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288562:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288569:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776555.288572:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776555.288575:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789776555.288581:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789776555.288589:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288596:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288602:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288608:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776555.288612:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288620:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288628:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cc3edec00) 00010000:00010000:0.0:1789776555.288630:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776555.288633:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288648:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb8853cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776555.288665:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c694b43c reply state 00000000d17cff05 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288674:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.288680:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a5cf512ca00) 00010000:00010000:0.0:1789776555.288683:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776555.288684:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789776555.288751:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:12198:x1876716432727808:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 8256us (8438us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789776555.288760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:3.0:1789776555.375050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776555.376878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728064 00000100:00100000:1.0:1789776555.376891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728064 00000100:00100000:2.0:1789776555.377126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:2.0:1789776555.377139:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+15:12206:x1876716432728064:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:2.0:1789776555.377163:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776555.377185:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8853e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab595d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377263:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377276:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377286:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776555.377330:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776555.377333:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776555.377352:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377374:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8853e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab595d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377391:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab595d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.377399:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:2.0:1789776555.377402:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776555.377406:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3e00, rc 0) 00000100:00100000:2.0:1789776555.377478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:12206:x1876716432728064:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 342us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776555.377484:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 155 00010000:00010000:0.0:1789776555.429620:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776555.430095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.430614:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728192 00000100:00100000:0.0:1789776555.430628:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728192 00000100:00100000:0.0:1789776555.430722:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:0.0:1789776555.430734:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+16:12212:x1876716432728192:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1789776555.430755:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776555.430777:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8853f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5964 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430846:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430860:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430887:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430899:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430906:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430913:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.430999:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431008:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431015:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776555.431053:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789776555.431057:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776555.431079:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431091:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431097:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431113:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431119:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776555.431124:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431132:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431145:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:0.0:1789776555.431148:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776555.431152:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431158:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb8853f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431172:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431178:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431184:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431189:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776555.431193:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431211:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431220:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a5cf512ca00) 00010000:00010000:0.0:1789776555.431222:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776555.431225:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431231:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431257:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8853f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5964 expref: 18 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431271:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5964 expref: 17 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.431278:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776555.431280:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789776555.431282:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9600, rc 0) 00000100:00100000:0.0:1789776555.431365:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:12212:x1876716432728192:12345-192.168.204.27@tcp:101:bash.0 Request processed in 633us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.431372:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:0.0:1789776555.435782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.438839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728448 00000100:00100000:2.0:1789776555.438863:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728448 00000100:00100000:2.0:1789776555.438977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:2.0:1789776555.438991:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+17:12212:x1876716432728448:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776555.439023:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776555.439052:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88540e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab596b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439190:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439210:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439224:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439411:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439432:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.439444:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776555.440056:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789776555.440432:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440450:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440471:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440607:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440617:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440625:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440633:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.440641:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440651:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440669:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776555.440673:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.440679:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440686:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776555.440707:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b580c5c reply state 000000005c660fad transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440723:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440730:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:2.0:1789776555.440738:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776555.440743:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789776555.440803:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88540e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440825:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.440834:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:2.0:1789776555.440837:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776555.440840:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3200, rc 0) 00000100:00100000:2.0:1789776555.441803:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12212:x1876716432728448:12345-192.168.204.27@tcp:101:bash.0 Request processed in 2804us (6028us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789776555.441815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:0.0:1789776555.456276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776555.456374:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728576 00000100:00100000:1.0:1789776555.456387:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728576 00000100:00100000:1.0:1789776555.456528:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1789776555.456544:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432728576:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776555.456580:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776555.456623:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5972 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776555.456668:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789776555.456735:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1789776555.456741:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776555.456755:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.456786:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.456807:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776555.456932:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432728576:12345-192.168.204.27@tcp:101:bash.0 Request processed in 392us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776555.456939:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1789776555.466891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.471236:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728704 00000100:00100000:0.0:1789776555.471261:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728704 00000100:00100000:0.0:1789776555.471366:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1789776555.471400:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:12212:x1876716432728704:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1789776555.471431:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776555.471478:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5979 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.471564:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.471579:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776555.471585:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776555.471593:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 7 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.471654:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.471676:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 7 pid: 8432 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776555.471693:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8528:1876716449565952:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776555.473731:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc36679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776555.486690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776555.486935:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8528:1876716449565952:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776555.486986:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 7 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.487018:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9200, rc 0) 00000100:00100000:2.0:1789776555.487146:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432728832 00000100:00100000:2.0:1789776555.487156:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432728832 00010000:00010000:2.0:1789776555.487210:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 8 pid: 8432 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776555.487256:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:2.0:1789776555.487271:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432728832:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776555.487295:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776555.487335:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 8 pid: 8432 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.487352:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 8 pid: 8432 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.487414:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9812d73/0xf13b8042cb885431 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5972 expref: 8 pid: 8432 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.487435:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776555.487441:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776555.487464:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 7 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.487477:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 7 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.487564:0:7458:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 7 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776555.487580:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7458:1876716449566080:192.168.204.27@tcp:105: 00000100:00100000:3.0:1789776555.489276:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:12212:x1876716432728704:12345-192.168.204.27@tcp:101:bash.0 Request processed in 17694us (22217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776555.489291:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1789776555.492418:0:7458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776555.496897:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7458:1876716449566080:192.168.204.27@tcp:105: 00010000:00010000:0.0:1789776555.496933:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776555.497031:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432728832:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 9762us (10359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.497074:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:1.0:1789776555.498078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.498324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432729088 00000100:00100000:0.0:1789776555.498335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432729088 00000100:00100000:0.0:1789776555.498538:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1789776555.498552:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12212:x1876716432729088:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1789776555.498972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:12212:x1876716432729088:12345-192.168.204.27@tcp:35:bash.0 Request processed in 422us (897us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789776555.498981:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:2.0:1789776555.597815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776555.599167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432729344 00000100:00100000:1.0:1789776555.599189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432729344 00000100:00100000:1.0:1789776555.599290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:1.0:1789776555.599304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:12222:x1876716432729344:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776555.599339:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776555.599370:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88543f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5980 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776555.599572:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789776555.599721:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88543f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5980 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.599741:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:1.0:1789776555.599764:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776555.599772:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88543f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5980 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.599792:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776555.599893:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12222:x1876716432729344:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 591us (2169us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789776555.599902:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:1.0:1789776555.605563:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.606244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432729600 00000100:00100000:2.0:1789776555.606259:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432729600 00000100:00100000:2.0:1789776555.606331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1789776555.606345:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12222:x1876716432729600:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776555.607029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:12222:x1876716432729600:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 682us (1477us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789776555.607039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1789776555.682040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.682154:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432729728 00000100:00100000:0.0:1789776555.682169:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432729728 00000100:00100000:0.0:1789776555.682262:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:0.0:1789776555.682276:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:12228:x1876716432729728:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776555.682327:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776555.682369:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88544d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5987 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682549:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682572:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682588:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776555.682666:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789776555.682670:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776555.682859:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682892:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88544d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5987 expref: 25 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682916:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5987 expref: 24 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.682932:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776555.682935:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776555.682940:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9e00, rc 0) 00000100:00100000:0.0:1789776555.683463:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:12228:x1876716432729728:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1179us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.683473:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:3.0:1789776555.696007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.696219:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432729984 00000100:00100000:2.0:1789776555.696236:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432729984 00000100:00100000:2.0:1789776555.696349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1789776555.696364:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:12228:x1876716432729984:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776555.696395:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776555.696428:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb88545b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab598e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.696655:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.696673:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.696690:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776555.696704:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789776555.696881:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb88545b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab598e expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.696913:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab598e expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.696923:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:2.0:1789776555.696927:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776555.696932:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3c00, rc 0) 00000100:00100000:2.0:1789776555.697040:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12228:x1876716432729984:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 680us (1051us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789776555.697075:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:1.0:1789776555.701858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.703319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730240 00000100:00100000:2.0:1789776555.703344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730240 00000100:00100000:2.0:1789776555.703464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:2.0:1789776555.703477:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12228:x1876716432730240:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776555.703531:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776555.703566:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885470 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5995 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.704158:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.704180:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.704195:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776555.704211:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789776555.704362:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5995 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.704386:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5995 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.704395:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:2.0:1789776555.704398:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789776555.704402:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:1.0:1789776555.706636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.706920:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730368 00000100:00100000:0.0:1789776555.706938:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730368 00000100:00100000:0.0:1789776555.707066:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1789776555.707080:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:2411:x1876716432730368:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776555.707112:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776555.707160:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab598e expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.707188:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:0.0:1789776555.707194:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776555.707300:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:2411:x1876716432730368:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 222us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.707309:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1789776555.709680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776555.710061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.710218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12228:x1876716432730240:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 6738us (8370us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789776555.710233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:3.0:1789776555.710407:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730496 00000100:00100000:3.0:1789776555.710419:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730496 00000100:00100000:0.0:1789776555.710511:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730624 00000100:00100000:0.0:1789776555.710521:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730624 00000100:00100000:0.0:1789776555.710574:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1789776555.710586:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2413:x1876716432730624:12345-192.168.204.27@tcp:16:kworker.0 00002000:00100000:3.0:1789776555.710659:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a5bc3d6dc00 x1876716432730496/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:746/0 lens 504/0 e 0 to 0 dl 1789776566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776555.710672:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d6dc00 with x1876716432730496 ext(0->12) 00002000:00010000:3.0:1789776555.710680:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a5bc3d6dc00 00000100:00100000:0.0:1789776555.710732:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2413:x1876716432730624:12345-192.168.204.27@tcp:16:kworker.0 Request processed in 146us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.710741:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1789776555.710792:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1789776555.710801:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2413:x1876716432730496:12345-192.168.204.27@tcp:4:bash.0 00000100:00100000:3.0:1789776555.711208:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789776555.711222:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789776555.719577:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2413:x1876716432730496:12345-192.168.204.27@tcp:4:bash.0 Request processed in 8761us (9513us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789776555.719592:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00002000:00100000:0.0:1789776555.719607:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a5bc3d6dc00 x1876716432730496/t4294967306(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:746/0 lens 504/448 e 0 to 0 dl 1789776566 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776555.719618:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d6dc00 with x1876716432730496 ext(0->12) 00002000:00010000:0.0:1789776555.719624:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a5bc3d6dc00 00000100:00100000:3.0:1789776555.721206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.722420:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730752 00000100:00100000:0.0:1789776555.722433:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730752 00000100:00100000:0.0:1789776555.722528:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1789776555.722540:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432730752:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:0.0:1789776555.722617:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.722638:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.722660:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776555.722665:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776555.722669:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.722710:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.722726:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 8 pid: 8528 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776555.722743:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876716449566208:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776555.722834:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776555.728571:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876716449566208:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776555.728605:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776555.729188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776555.729528:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432730880 00000100:00100000:3.0:1789776555.729555:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432730880 00010000:00010000:3.0:1789776555.729596:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 9 pid: 8528 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776555.729651:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:3.0:1789776555.729663:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432730880:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776555.729684:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789776555.729709:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789776555.729713:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789776556 00002000:00010000:3.0:1789776555.729715:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789776556 00002000:00010000:3.0:1789776555.729717:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789776555.729724:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 9 pid: 8528 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.729739:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 9 pid: 8528 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.729766:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000656700e/0xf13b8042cb885438 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5979 expref: 9 pid: 8528 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.729784:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776555.729788:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776555.729795:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.729805:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776555.729855:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776555.730042:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730052:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730080:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730090:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730098:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730119:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776555.730123:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730134:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730148:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.730156:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e192d284/0xf13b8042cb885485 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776555.730248:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432730880:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 585us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776555.730257:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:1.0:1789776555.732536:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432730752:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 9982us (11323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776555.732551:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1789776555.743384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.747287:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432731136 00000100:00100000:0.0:1789776555.747306:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432731136 00000100:00100000:0.0:1789776555.747374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:0.0:1789776555.747385:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12228:x1876716432731136:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:0.0:1789776555.747835:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5995 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776555.748105:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789776555.748139:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789776555.748614:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789776555.748842:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.748862:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.748870:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.748906:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.748923:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 31 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776555.748939:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1876716449566336:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776555.749095:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776555.757315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.757716:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1876716449566336:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776555.757748:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776555.757879:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432731264 00000100:00100000:1.0:1789776555.757886:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432731264 00010000:00010000:1.0:1789776555.757930:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 32 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776555.757977:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:1.0:1789776555.757988:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+32:2411:x1876716432731264:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776555.758003:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776555.758027:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 32 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758042:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 32 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758068:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab596b expref: 32 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758086:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:1.0:1789776555.758091:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758101:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758108:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776555.758141:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776555.758201:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:2411:x1876716432731264:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 215us (4891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776555.758209:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00010000:00010000:0.0:1789776555.758469:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.758477:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776555.758629:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1789776555.759093:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789776555.759190:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449566464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789776555.759258:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776555.759352:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776555.769438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449566464 00000100:00100000:2.0:1789776555.769466:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449566464 00000100:00100000:2.0:1789776555.769555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789776555.769567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449566464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776555.769739:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449566464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (10479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776555.769746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789776555.769904:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449566464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789776555.770064:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789776555.770143:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449566592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789776555.770181:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776555.770210:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776555.770471:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449566592 00000100:00100000:2.0:1789776555.770476:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449566592 00000100:00100000:2.0:1789776555.770541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789776555.770549:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876716449566592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789776555.770986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1876716449566592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 436us (803us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789776555.770994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789776555.771073:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1876716449566592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789776555.771117:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789776555.771154:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771165:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771172:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771178:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.771183:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771205:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771223:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:2.0:1789776555.771226:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789776555.771231:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.771237:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88548c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776555.771338:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789776555.771398:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789776555.771409:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377015915215ns, next at 378015913006ns, rc = 0 00000001:00080000:2.0:1789776555.771415:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789776555.771436:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc2122100) 00010000:00010000:2.0:1789776555.771438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789776555.771446:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885477 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5995 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776555.776051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:12228:x1876716432731136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 28654us (32665us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789776555.776065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000020:00080000:3.0:1789776555.776072:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789776555.779083:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.779159:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432731392 00000100:00100000:0.0:1789776555.779168:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432731392 00000100:00100000:0.0:1789776555.779228:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1789776555.779238:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+34:12228:x1876716432731392:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776555.779263:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776555.779285:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885493 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab599c expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.779343:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab599c expref: 35 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.779358:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab599c expref: 35 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.779378:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776555.779381:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776555.779384:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9200, rc 0) 00000100:00100000:0.0:1789776555.779446:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:12228:x1876716432731392:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 210us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.779465:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:1.0:1789776555.792736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.792866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432731648 00000100:00100000:2.0:1789776555.792879:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432731648 00000100:00100000:2.0:1789776555.792942:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1789776555.792953:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:12228:x1876716432731648:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776555.793193:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:12228:x1876716432731648:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 241us (466us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789776555.793201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1789776555.898043:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.898202:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432731904 00000100:00100000:0.0:1789776555.898226:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432731904 00000100:00100000:0.0:1789776555.898291:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:0.0:1789776555.898302:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:12238:x1876716432731904:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776555.898327:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776555.898350:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb88549a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776555.898472:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789776555.898846:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb88549a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59a3 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.898860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:0.0:1789776555.898863:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776555.898869:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb88549a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59a3 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.898882:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9400, rc 0) 00000100:00100000:0.0:1789776555.899065:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:12238:x1876716432731904:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 764us (1046us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789776555.899074:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:1.0:1789776555.904354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.904831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432732032 00000100:00100000:2.0:1789776555.904842:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432732032 00000100:00100000:2.0:1789776555.904939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:2.0:1789776555.904951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:12238:x1876716432732032:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1789776555.905123:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905140:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905153:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905165:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905173:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905180:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905257:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905266:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905273:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776555.905348:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905362:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905368:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905375:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905381:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.905386:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905393:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905406:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776555.905409:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.905415:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905421:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905435:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905442:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905471:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905476:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.905480:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905487:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905516:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:2.0:1789776555.905519:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.905522:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905529:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905540:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905547:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905553:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905559:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.905562:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905577:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905585:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776555.905588:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.905591:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.905596:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776555.905749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:12238:x1876716432732032:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 799us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776555.905758:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:1.0:1789776555.909001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.909198:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432732288 00000100:00100000:2.0:1789776555.909208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432732288 00000100:00100000:2.0:1789776555.909303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1789776555.909315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+37:12238:x1876716432732288:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776555.909575:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12238:x1876716432732288:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 262us (582us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789776555.909583:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1789776555.957476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776555.957706:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432732544 00000100:00100000:2.0:1789776555.957794:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432732544 00000100:00100000:2.0:1789776555.957862:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:2.0:1789776555.957873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12241:x1876716432732544:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776555.957899:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776555.957922:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59aa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958017:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958033:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958045:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958057:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958063:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958069:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958418:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958456:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958468:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776555.958483:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789776555.958661:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958670:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958690:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958697:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.958702:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958711:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958740:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776555.958744:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.958749:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958756:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958772:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958779:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958785:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958790:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776555.958798:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958813:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958821:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:2.0:1789776555.958823:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776555.958826:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.958832:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8854cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.959490:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb8854bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.959569:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776555.959578:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776555.959580:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776555.959584:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2c00, rc 0) 00000100:00100000:2.0:1789776555.960013:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12241:x1876716432732544:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 2138us (2562us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789776555.960024:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:1.0:1789776555.968377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.968536:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432732672 00000100:00100000:0.0:1789776555.968547:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432732672 00000100:00100000:0.0:1789776555.968603:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:0.0:1789776555.968620:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12241:x1876716432732672:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1789776555.968701:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968729:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968749:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968787:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968795:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968802:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968807:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776555.968812:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968819:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968830:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776555.968833:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776555.968838:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776555.968844:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb8854e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776555.968926:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12241:x1876716432732672:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 314us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.968933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1789776555.974776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776555.974892:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432732928 00000100:00100000:0.0:1789776555.974920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432732928 00000100:00100000:0.0:1789776555.974984:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1789776555.974996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12241:x1876716432732928:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776555.975688:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:12241:x1876716432732928:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 690us (918us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789776555.975697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1789776556.266464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776556.269577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432733184 00000100:00100000:1.0:1789776556.269593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432733184 00000100:00100000:1.0:1789776556.270044:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:1.0:1789776556.270056:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:12272:x1876716432733184:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:1.0:1789776556.270086:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776556.270109:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8854e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.270226:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8854ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.270242:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8854ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.270253:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8854ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776556.270264:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789776556.270371:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8854e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b1 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.270390:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8854ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b1 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.270398:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776556.270401:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776556.270405:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0e00, rc 0) 00000100:00100000:1.0:1789776556.270552:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12272:x1876716432733184:12345-192.168.204.27@tcp:101:cat.0 Request processed in 498us (4113us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789776556.270559:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:1.0:1789776556.278833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776556.279331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432733312 00000100:00100000:3.0:1789776556.279343:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432733312 00000100:00100000:3.0:1789776556.279423:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1789776556.279435:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:2411:x1876716432733312:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776556.279466:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776556.279513:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8854ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b1 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.279547:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776556.279553:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776556.279624:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:2411:x1876716432733312:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 191us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776556.279632:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1789776556.283203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776556.283282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432733568 00000100:00100000:3.0:1789776556.283292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432733568 00000100:00100000:3.0:1789776556.283354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1789776556.283365:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:12272:x1876716432733568:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:3.0:1789776556.283752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12272:x1876716432733568:12345-192.168.204.27@tcp:35:cat.0 Request processed in 387us (557us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789776556.283760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1789776556.340760:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776556.340870:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432733824 00000100:00100000:2.0:1789776556.340880:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432733824 00000100:00100000:2.0:1789776556.340952:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:2.0:1789776556.340964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12278:x1876716432733824:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1789776556.341021:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776556.341035:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789776556.341064:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5987 expref: 43 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341084:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776556.341088:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776556.341100:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341204:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341218:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341225:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341256:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.341269:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 43 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776556.341282:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449566720:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776556.341472:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776556.345878:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449566720:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776556.345910:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776556.346105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776556.347589:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432733952 00000100:00100000:1.0:1789776556.347600:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432733952 00010000:00010000:1.0:1789776556.347803:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 44 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776556.347906:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:1.0:1789776556.347917:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:2412:x1876716432733952:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776556.347933:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776556.347940:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 44 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.347953:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 44 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.347990:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb8854d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59aa expref: 44 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.348007:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776556.348012:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.348021:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.348060:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.348091:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776556.348155:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:2412:x1876716432733952:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 240us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.348164:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00010000:00010000:2.0:1789776556.348882:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.348892:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776556.348912:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789776556.349078:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8854fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.349096:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.349103:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776556.349106:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776556.349109:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2a00, rc 0) 00000100:00100000:2.0:1789776556.349159:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12278:x1876716432733824:12345-192.168.204.27@tcp:101:dd.0 Request processed in 8197us (8413us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789776556.349167:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:2.0:1789776556.352935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776556.353207:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432734080 00000100:00100000:1.0:1789776556.353217:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432734080 00000100:00100000:1.0:1789776556.353387:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:1.0:1789776556.353398:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12278:x1876716432734080:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:1.0:1789776556.353816:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776556.353961:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885511 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59bf expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354005:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354021:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354104:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354243:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb885511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 45 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354266:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 44 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776556.354345:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776556.354349:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776556.354353:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9400, rc 0) 00000100:00100000:0.0:1789776556.354701:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:12278:x1876716432734080:12345-192.168.204.27@tcp:101:dd.0 Request processed in 1303us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776556.354718:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:3.0:1789776556.358132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776556.358193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432734336 00000100:00100000:1.0:1789776556.358202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432734336 00000100:00100000:1.0:1789776556.358262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:1.0:1789776556.358273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:12278:x1876716432734336:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:1.0:1789776556.358550:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.358568:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.358580:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776556.358622:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789776556.358645:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6cadf65 reply state 0000000014b8c6dc transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.358678:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.358686:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776556.358689:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776556.358693:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776556.358929:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:12278:x1876716432734336:12345-192.168.204.27@tcp:36:dd.0 Request processed in 656us (804us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789776556.358937:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 170 00000020:00080000:1.0:1789776556.358942:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776556.450745:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776556.690394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776556.690518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432734464 00000100:00100000:2.0:1789776556.690528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432734464 00000100:00100000:2.0:1789776556.690611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:2.0:1789776556.690622:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:12292:x1876716432734464:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1789776556.690646:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776556.690667:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885526 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690760:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690776:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690787:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690806:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690812:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690882:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690908:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690917:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690954:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.690979:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 48 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776556.690996:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449566848:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776556.691085:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776556.699381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776556.699533:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432734720 00000100:00100000:3.0:1789776556.699556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432734720 00000100:00100000:3.0:1789776556.699609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1789776556.699620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:6646:x1876716432734720:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789776556.699932:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:6646:x1876716432734720:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 313us (561us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789776556.699940:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:0.0:1789776556.706588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776556.706771:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449566848:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776556.706803:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776556.706827:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432734848 00000100:00100000:3.0:1789776556.706835:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432734848 00010000:00010000:3.0:1789776556.706879:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 50 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776556.706951:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1789776556.706963:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:2411:x1876716432734848:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776556.706983:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776556.706992:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 50 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707006:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 50 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707031:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885503 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59b8 expref: 50 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707048:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776556.707053:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707064:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707072:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776556.707100:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776556.707158:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:2411:x1876716432734848:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 197us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776556.707167:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00010000:00010000:1.0:1789776556.708487:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708533:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776556.708608:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789776556.708613:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776556.708642:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708656:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708666:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708686:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708693:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708699:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776556.708704:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708711:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708726:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776556.708729:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776556.708733:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708739:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb88552d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708753:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708759:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708764:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708770:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776556.708779:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708785:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708793:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:1.0:1789776556.708796:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776556.708799:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708804:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708842:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59c6 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708855:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59c6 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776556.708862:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776556.708864:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776556.708867:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3200, rc 0) 00000100:00100000:1.0:1789776556.708952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:12292:x1876716432734464:12345-192.168.204.27@tcp:101:stat.0 Request processed in 18330us (18567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.708960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:0.0:1789776556.815875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776556.816029:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432735104 00000100:00100000:2.0:1789776556.816040:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432735104 00000100:00100000:2.0:1789776556.816109:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:2.0:1789776556.816120:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:12298:x1876716432735104:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:2.0:1789776556.816178:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776556.816208:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb88553b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59c6 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.816229:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776556.816234:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776556.816408:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.816423:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.816448:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776556.816550:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789776556.816575:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0fed385 reply state 000000006391a966 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.816732:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776556.816740:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776556.816742:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776556.816745:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776556.816951:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:12298:x1876716432735104:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 832us (1085us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789776556.816959:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 172 00000020:00080000:2.0:1789776556.816964:0:13443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789776557.015606:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.022097:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432735232 00000100:00100000:1.0:1789776557.022113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432735232 00000100:00100000:1.0:1789776557.022210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:1.0:1789776557.022223:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+50:12312:x1876716432735232:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:1.0:1789776557.022261:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776557.022282:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885549 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022350:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022365:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022387:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022400:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022408:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022573:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022713:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022730:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776557.022775:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789776557.022786:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776557.022810:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022824:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022834:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022840:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022847:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022852:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776557.022856:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022864:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022878:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776557.022882:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776557.022887:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022892:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885550 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022906:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022923:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022928:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022933:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776557.022936:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022941:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.022949:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:1.0:1789776557.022952:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776557.022955:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.023554:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.023592:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885549 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.023606:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 51 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.023612:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.023615:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776557.023625:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776557.023783:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:12312:x1876716432735232:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1562us (8187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.023792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00080000:2.0:1789776557.024332:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776557.091092:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449566976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776557.091157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776557.091292:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449566976 00000100:00100000:0.0:1789776557.091299:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449566976 00000100:00100000:0.0:1789776557.091348:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000040:00080000:3.0:1789776557.091363:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789776557.091365:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449566976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776557.091402:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789776557.091461:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449566976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776557.091468:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789776557.091488:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449566976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776557.092159:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776557.092172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449567104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776557.092208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776557.092457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449567104 00000100:00100000:3.0:1789776557.092462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449567104 00000100:00100000:3.0:1789776557.092516:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789776557.092523:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449567104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776557.092546:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776557.092596:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449567104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776557.092603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789776557.092642:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449567104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776557.142911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.143023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432735488 00000100:00100000:1.0:1789776557.143034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432735488 00000100:00100000:1.0:1789776557.143095:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:1.0:1789776557.143105:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+51:12322:x1876716432735488:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776557.143124:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776557.143143:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776557.143238:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789776557.143332:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885565 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59d4 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.143345:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:1.0:1789776557.143348:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776557.143353:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59d4 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.143365:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0000, rc 0) 00000100:00100000:1.0:1789776557.143629:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:12322:x1876716432735488:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 524us (726us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789776557.143636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:3.0:1789776557.152696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.162680:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432735744 00000100:00100000:0.0:1789776557.162696:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432735744 00000100:00100000:0.0:1789776557.162781:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1789776557.162795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc90b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+52:12322:x1876716432735744:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776557.163370:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc90b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:12322:x1876716432735744:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 576us (10682us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789776557.163378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1789776557.256302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.257183:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736000 00000100:00100000:0.0:1789776557.257198:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736000 00000100:00100000:2.0:1789776557.257872:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:2.0:1789776557.257890:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:12328:x1876716432736000:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776557.257936:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776557.257968:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885573 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59db expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.258142:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.258161:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.258171:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.258238:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.258256:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 54 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776557.258286:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449567232:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776557.258458:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776557.265756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.265859:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736128 00000100:00100000:1.0:1789776557.265873:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736128 00010000:00010000:1.0:1789776557.265933:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 55 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776557.265991:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:1.0:1789776557.266003:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:2412:x1876716432736128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776557.266024:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776557.266032:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 55 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.266055:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 55 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.266096:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.266103:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.266116:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.266126:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.266151:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776557.266264:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb88555e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59cd expref: 55 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776557.266826:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449567232:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776557.266861:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.266872:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.266878:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776557.266905:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1789776557.267284:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:2412:x1876716432736128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1274us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.267296:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00010000:00010000:2.0:1789776557.267763:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb885573 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 55 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.267788:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 54 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.267821:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776557.267824:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776557.267827:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776557.267883:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:12328:x1876716432736000:12345-192.168.204.27@tcp:101:bash.0 Request processed in 9998us (11610us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789776557.267891:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:3.0:1789776557.276036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.276969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736384 00000100:00100000:1.0:1789776557.277005:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736384 00000100:00100000:1.0:1789776557.277267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:1.0:1789776557.277282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+54:12328:x1876716432736384:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:1.0:1789776557.277891:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.278711:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.278735:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776557.278819:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789776557.278860:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000830ccc0f reply state 00000000f3e86ad6 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.278875:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.278884:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.278887:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776557.278893:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776557.279464:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12328:x1876716432736384:12345-192.168.204.27@tcp:36:bash.0 Request processed in 2179us (3435us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789776557.279473:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00000020:00080000:1.0:1789776557.279481:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789776557.288481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.288906:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736512 00000100:00100000:1.0:1789776557.288920:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736512 00000100:00100000:1.0:1789776557.289040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:1.0:1789776557.289062:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12328:x1876716432736512:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776557.289118:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776557.289145:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88558f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.289266:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.289285:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 58 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.289294:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.289337:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 58 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.289351:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 58 pid: 13443 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776557.289367:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449567360:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776557.289535:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776557.294297:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449567360:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776557.294346:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776557.294925:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776557.294999:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736640 00000100:00100000:2.0:1789776557.295009:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736640 00010000:00010000:2.0:1789776557.295080:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 59 pid: 13443 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776557.295129:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:2.0:1789776557.295140:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:2412:x1876716432736640:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776557.295160:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776557.295168:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 59 pid: 13443 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295182:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 59 pid: 13443 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295211:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb88557a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59db expref: 59 pid: 13443 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295231:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776557.295236:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295272:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295281:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.295318:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776557.295391:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:2412:x1876716432736640:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 252us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776557.295400:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00010000:00010000:1.0:1789776557.295777:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.295787:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776557.295868:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789776557.295874:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776557.295901:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.295940:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88558f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59e2 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.295959:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59e2 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.295967:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.295970:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776557.295973:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0200, rc 0) 00000100:00100000:1.0:1789776557.296063:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12328:x1876716432736512:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7013us (7595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.296071:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:0.0:1789776557.300363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776557.300956:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432736896 00000100:00100000:3.0:1789776557.300972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432736896 00000100:00100000:3.0:1789776557.301088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1789776557.301101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12328:x1876716432736896:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1789776557.302270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:12328:x1876716432736896:12345-192.168.204.27@tcp:35:bash.0 Request processed in 1160us (1911us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789776557.302282:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1789776557.394764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.395866:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432737152 00000100:00100000:0.0:1789776557.395884:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432737152 00000100:00100000:0.0:1789776557.396059:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:0.0:1789776557.396073:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+58:12338:x1876716432737152:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776557.396111:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776557.396143:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88559d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59e9 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776557.396300:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789776557.396466:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88559d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59e9 expref: 60 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776557.396486:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:0.0:1789776557.396490:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776557.397476:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88559d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59e9 expref: 60 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776557.397543:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9c00, rc 0) 00000100:00100000:0.0:1789776557.397666:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12338:x1876716432737152:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1595us (2916us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789776557.397676:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:1.0:1789776557.402567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776557.402773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432737280 00000100:00100000:2.0:1789776557.402787:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432737280 00000100:00100000:2.0:1789776557.402873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:2.0:1789776557.402886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12338:x1876716432737280:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1789776557.403007:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403067:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403081:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403089:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403119:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403218:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403229:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403237:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776557.403304:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403320:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403326:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403334:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403340:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776557.403344:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403352:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403367:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776557.403377:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776557.403384:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403391:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403409:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403415:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403433:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403439:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776557.403442:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403448:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403457:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:2.0:1789776557.403460:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776557.403463:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403468:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb8855b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403479:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403517:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403523:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403539:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776557.403543:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403550:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403560:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776557.403562:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776557.403565:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.403570:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb8855b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776557.403680:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12338:x1876716432737280:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 793us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776557.403690:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:2.0:1789776557.412390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.412974:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432737536 00000100:00100000:0.0:1789776557.412988:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432737536 00000100:00100000:0.0:1789776557.413074:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1789776557.413086:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12338:x1876716432737536:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776557.413962:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:12338:x1876716432737536:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 872us (1582us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789776557.413998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00010000:00010000:3.0:1789776557.474804:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776557.476569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.476716:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432737792 00000100:00100000:1.0:1789776557.476731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432737792 00000100:00100000:1.0:1789776557.476814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:1.0:1789776557.476826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:12341:x1876716432737792:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776557.476859:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776557.476885:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.476982:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477018:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477032:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477047:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477055:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477062:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477207:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8855d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477217:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8855d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477224:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8855d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776557.477235:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789776557.477335:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477343:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477350:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477363:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776557.477368:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477376:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477390:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776557.477392:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776557.477398:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477404:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8855c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477433:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477440:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477445:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477449:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776557.477452:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477458:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477475:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:1.0:1789776557.477478:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776557.477481:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477486:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8855ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477601:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f0 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477617:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8855d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f0 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.477625:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.477628:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776557.477630:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776557.477712:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:12341:x1876716432737792:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 887us (1155us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789776557.477720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:2.0:1789776557.494993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776557.495186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.496862:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432737920 00000100:00100000:0.0:1789776557.496880:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432737920 00000100:00100000:0.0:1789776557.496994:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1789776557.497006:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:2411:x1876716432737920:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776557.497039:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776557.497075:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8855d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f0 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776557.497101:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776557.497108:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776557.497194:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:2411:x1876716432737920:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 189us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776557.497203:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1789776557.501214:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432738048 00000100:00100000:1.0:1789776557.501240:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432738048 00000100:00100000:1.0:1789776557.501858:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:1.0:1789776557.501873:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12341:x1876716432738048:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1789776557.501985:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502009:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502056:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502107:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502115:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502123:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502130:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776557.502135:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502143:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502158:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776557.502161:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776557.502167:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.502174:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8855e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776557.502283:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12341:x1876716432738048:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 414us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.502291:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:3.0:1789776557.507854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.508838:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432738304 00000100:00100000:0.0:1789776557.508854:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432738304 00000100:00100000:0.0:1789776557.508930:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1789776557.508943:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12341:x1876716432738304:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776557.509291:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:12341:x1876716432738304:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 347us (1452us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789776557.509300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000040:00080000:2.0:1789776557.668310:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776557.668326:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776557.668547:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789776557.668557:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776557.743598:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776557.743777:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432738560 00000100:00100000:3.0:1789776557.743787:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432738560 00000100:00100000:3.0:1789776557.743909:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:3.0:1789776557.743920:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:12359:x1876716432738560:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1789776557.743961:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776557.743985:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8855ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59f7 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.744119:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8855f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.744135:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8855f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.744147:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8855f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776557.744158:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789776557.744289:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8855ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f7 expref: 65 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.744309:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8855f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f7 expref: 64 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.744318:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776557.744321:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789776557.744325:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ca00, rc 0) 00000100:00100000:3.0:1789776557.744405:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12359:x1876716432738560:12345-192.168.204.27@tcp:101:cat.0 Request processed in 487us (816us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789776557.744423:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:3.0:1789776557.799684:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776557.799982:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432738688 00000100:00100000:2.0:1789776557.799997:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432738688 00000100:00100000:2.0:1789776557.800103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:2.0:1789776557.800117:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12361:x1876716432738688:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776557.800153:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776557.800184:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab59fe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800273:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800292:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800309:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776557.800366:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789776557.800371:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776557.800397:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800443:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8855ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59fe expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800465:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59fe expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.800613:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776557.800617:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776557.800622:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3800, rc 0) 00000100:00100000:2.0:1789776557.800704:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12361:x1876716432738688:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 588us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776557.800712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:2.0:1789776557.812788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776557.819266:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739072 00000100:00100000:0.0:1789776557.819288:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739072 00000100:00100000:0.0:1789776557.819405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1789776557.820368:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12361:x1876716432739072:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776557.821562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12361:x1876716432739072:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 1199us (8778us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789776557.822745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1789776557.825790:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776557.836355:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739200 00000100:00100000:2.0:1789776557.836380:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739200 00000100:00100000:2.0:1789776557.836544:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1789776557.836559:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12361:x1876716432739200:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:2.0:1789776557.836934:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789776557.837281:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885596 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59e2 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.837318:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8855f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59f7 expref: 65 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.837331:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885493 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab599c expref: 64 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776557.837344:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:2.0:1789776557.837350:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776557.837710:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12361:x1876716432739200:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 1151us (12046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776557.837743:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1789776557.842290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776557.842895:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739328 00000100:00100000:1.0:1789776557.842911:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739328 00000100:00100000:1.0:1789776557.843008:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:1.0:1789776557.843021:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12361:x1876716432739328:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:1.0:1789776557.843292:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.843320:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.843336:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776557.844267:0:13443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789776557.846144:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12361:x1876716432739328:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 1386us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.846656:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:2.0:1789776557.874426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776557.875033:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739456 00000100:00100000:3.0:1789776557.875073:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739456 00000100:00100000:3.0:1789776557.875154:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1789776557.875167:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12363:x1876716432739456:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776557.875197:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776557.875226:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885614 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a05 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875317:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875337:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875353:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875369:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875377:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875384:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875708:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875721:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875729:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776557.875801:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789776557.875877:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776557.875909:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875924:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875933:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875939:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875946:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875953:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776557.875958:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875967:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875983:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776557.875986:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776557.875992:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.875999:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88561b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876030:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876037:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876044:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876050:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776557.876053:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876059:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876068:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:3.0:1789776557.876070:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776557.876074:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876080:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876117:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885614 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 65 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876133:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 64 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776557.876154:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776557.876156:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776557.876160:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d400, rc 0) 00000100:00100000:3.0:1789776557.876256:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12363:x1876716432739456:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1091us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776557.876266:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00010000:00010000:0.0:1789776558.498809:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776558.626718:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776558.626743:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449567488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776558.626820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776558.626878:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449567488 00000100:00100000:1.0:1789776558.626886:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449567488 00000100:00100000:1.0:1789776558.626943:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789776558.626953:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449567488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776558.626985:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789776558.627029:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449567488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.627036:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789776558.627071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776558.627126:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449567488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776558.627549:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776558.627573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449567616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776558.627604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776558.627635:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449567616 00000100:00100000:1.0:1789776558.627639:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449567616 00000100:00100000:1.0:1789776558.627671:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789776558.627678:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449567616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776558.627690:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789776558.627725:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449567616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.627731:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789776558.627745:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776558.627766:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449567616:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789776558.668792:0:14653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776558.668801:0:14653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776558.668837:0:14653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789776558.668843:0:14653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789776558.690670:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776558.690681:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776558.690704:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789776558.690713:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776558.690869:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449567744:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776558.690965:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfc2b6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776558.710439:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449567744:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776558.710850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.710885:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739584 00000100:00100000:1.0:1789776558.710892:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739584 00000100:00100000:1.0:1789776558.710941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1789776558.710950:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12374:x1876716432739584:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776558.710978:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776558.711100:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12374:x1876716432739584:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 150us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.711107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:3.0:1789776558.728909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.729520:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739712 00000100:00100000:1.0:1789776558.729531:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739712 00000100:00100000:1.0:1789776558.729585:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:1.0:1789776558.729603:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12374:x1876716432739712:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.729678:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729695:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729707:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729783:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729793:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729800:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729832:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729842:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.729848:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776558.729985:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789776558.729990:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776558.730004:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730027:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730033:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730040:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730047:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.730051:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730058:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730070:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:1.0:1789776558.730073:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776558.730077:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730084:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885630 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730094:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730100:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730104:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730113:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.730116:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730122:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730131:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8a5cc3edea00) 00010000:00010000:1.0:1789776558.730133:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776558.730136:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730142:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885637 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730155:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730161:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730167:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730171:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.730174:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730179:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730194:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776558.730196:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776558.730199:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.730204:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88563e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.730288:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12374:x1876716432739712:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 686us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.730295:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1789776558.737281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.737325:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432739968 00000100:00100000:0.0:1789776558.737335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432739968 00000100:00100000:0.0:1789776558.737408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1789776558.737420:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12374:x1876716432739968:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.737443:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776558.737466:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885645 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737609:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737625:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737637:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776558.737649:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789776558.737962:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737971:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737977:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737983:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776558.737988:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.737996:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.738008:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776558.738011:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776558.738015:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.738021:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb88564c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.738082:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885645 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a0c expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.738094:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:0.0:1789776558.738096:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776558.738100:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb885645 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a0c expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.738122:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc25f9200, rc 0) 00000100:00100000:0.0:1789776558.738185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432739968:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 766us (913us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789776558.738193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1789776558.743141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.743304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432740096 00000100:00100000:1.0:1789776558.743315:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432740096 00000100:00100000:1.0:1789776558.743380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:1.0:1789776558.743410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432740096:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776558.743447:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776558.743843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432740096:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 452us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.743852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:1.0:1789776558.750956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.750997:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432740352 00000100:00100000:1.0:1789776558.751006:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432740352 00000100:00100000:1.0:1789776558.751139:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:1.0:1789776558.751151:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432740352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.751172:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776558.751176:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776558.751220:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885606 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59fe expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.751239:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776558.751244:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776558.751258:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88565a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a13 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776558.751975:0:13443:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789776558.752214:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.752229:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.752240:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.752302:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb88565a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a13 expref: 67 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.752320:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a13 expref: 66 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.752328:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cc3edea00) 00010000:00010000:1.0:1789776558.752331:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776558.752333:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0e00, rc 0) 00000100:00100000:1.0:1789776558.752420:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12374:x1876716432740352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1272us (1475us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789776558.752439:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:2.0:1789776558.765763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.765901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432740608 00000100:00100000:0.0:1789776558.765913:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432740608 00000100:00100000:0.0:1789776558.765983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:0.0:1789776558.765994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12374:x1876716432740608:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.766240:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776558.766277:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb885661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a13 expref: 66 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766298:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cc3edea00) 00010000:00010000:0.0:1789776558.766310:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776558.766337:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766351:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766361:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766435:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766455:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766463:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766539:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766548:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.766554:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767775:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776558.767781:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767791:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767805:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776558.767808:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776558.767812:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767818:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9200/0xf13b8042cb88566f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767830:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767843:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767849:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767854:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776558.767857:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767863:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767871:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd73146b1 (ffff8a5cf512cd00) 00010000:00010000:0.0:1789776558.767873:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776558.767876:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.767881:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9e00/0xf13b8042cb885676 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd73146b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.767991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432740608:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 1996us (2236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776558.768001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:1.0:1789776558.772203:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.772273:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432740736 00000100:00100000:0.0:1789776558.772283:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432740736 00000100:00100000:0.0:1789776558.772339:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:0.0:1789776558.772350:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12374:x1876716432740736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.772371:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776558.772417:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88567d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a1a expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772468:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772481:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772513:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772632:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9c00/0xf13b8042cb88567d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 67 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772652:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 66 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.772792:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:0.0:1789776558.772797:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776558.772802:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf400, rc 0) 00000100:00100000:0.0:1789776558.772861:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12374:x1876716432740736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 512us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776558.772868:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:1.0:1789776558.786658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.786807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432740992 00000100:00100000:0.0:1789776558.786819:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432740992 00000100:00100000:0.0:1789776558.786881:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:0.0:1789776558.786892:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12374:x1876716432740992:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.786976:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.787004:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.787015:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776558.787215:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1789776558.787226:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380031732754ns, next at 381031730159ns, rc = 0 00000004:00010000:0.0:1789776558.787278:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed88b36f reply state 00000000c905965e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.787291:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.787299:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:0.0:1789776558.787302:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789776558.787307:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776558.787420:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12374:x1876716432740992:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 530us (772us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789776558.787427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:0.0:1789776558.790200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.790302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432741120 00000100:00100000:1.0:1789776558.790312:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432741120 00000100:00100000:1.0:1789776558.790371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:1.0:1789776558.790381:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12374:x1876716432741120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.790414:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776558.790435:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a21 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.790516:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.790533:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.790553:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.790557:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776558.791217:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776558.792179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12374:x1876716432741120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1792us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.792190:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:3.0:1789776558.800621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.800849:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432741248 00000100:00100000:0.0:1789776558.800859:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432741248 00000100:00100000:0.0:1789776558.800935:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1789776558.800946:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432741248:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789776558.801168:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776558.802272:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432741248:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 1323us (1658us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789776558.802284:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1789776558.816963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.817025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432741504 00000100:00100000:3.0:1789776558.817036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432741504 00000100:00100000:3.0:1789776558.817100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1789776558.817110:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12374:x1876716432741504:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789776558.817321:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+70:12374:x1876716432741504:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 212us (367us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789776558.817328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:1.0:1789776558.822643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.822787:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432741760 00000100:00100000:3.0:1789776558.822799:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432741760 00000100:00100000:3.0:1789776558.822871:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:3.0:1789776558.822882:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+70:12374:x1876716432741760:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789776558.823000:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+70:12374:x1876716432741760:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 119us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.823008:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:0.0:1789776558.826211:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.831630:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432741888 00000100:00100000:1.0:1789776558.831644:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432741888 00000100:00100000:1.0:1789776558.831759:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:1.0:1789776558.831770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+70:12374:x1876716432741888:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.831791:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776558.831814:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.831900:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.831916:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.831928:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776558.831979:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776558.831999:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.832027:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb885699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a28 expref: 72 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.832058:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a28 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.832068:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.832070:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789776558.832074:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0a00, rc 0) 00000100:00100000:1.0:1789776558.832150:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12374:x1876716432741888:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 382us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.832158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:3.0:1789776558.842847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776558.842984:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742016 00000100:00100000:2.0:1789776558.842997:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742016 00000100:00100000:2.0:1789776558.843077:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1789776558.843088:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432742016:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776558.843106:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776558.843126:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a2f expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776558.843152:0:8528:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2af, blocks: 0x0 00010000:00010000:2.0:1789776558.843172:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789776558.843177:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776558.843186:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.843205:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.843237:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3c00, rc 0) 00000100:00100000:2.0:1789776558.843297:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432742016:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 210us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.843304:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1789776558.854179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776558.854533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742272 00000100:00100000:2.0:1789776558.854545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742272 00000100:00100000:2.0:1789776558.854615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:2.0:1789776558.854626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12374:x1876716432742272:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776558.854747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12374:x1876716432742272:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 123us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.854756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:3.0:1789776558.858852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.858896:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742400 00000100:00100000:3.0:1789776558.858907:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742400 00000100:00100000:3.0:1789776558.858961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1789776558.858971:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:12374:x1876716432742400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776558.858989:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776558.859009:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a36 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.859055:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.859066:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776558.859072:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776558.859078:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.859115:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.859130:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776558.859145:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449567872:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776558.859236:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc552f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776558.861556:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449567872:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776558.862768:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.862790:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:3.0:1789776558.862853:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:12374:x1876716432742400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 3883us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.862861:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:0.0:1789776558.865750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.865789:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742528 00000100:00100000:0.0:1789776558.865798:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742528 00010000:00010000:0.0:1789776558.865844:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.865886:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:0.0:1789776558.865896:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432742528:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776558.865911:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776558.865932:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.865945:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.865972:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a123aa/0xf13b8042cb8856a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a2f expref: 9 pid: 8528 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.865986:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776558.865991:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776558.865999:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.866009:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.866207:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.866223:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4524000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1876716449568000:192.168.204.27@tcp:105: 00000100:00100000:0.0:1789776558.866305:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd97df180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776558.871335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.871463:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742656 00000100:00100000:3.0:1789776558.871583:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742656 00002000:00100000:3.0:1789776558.871632:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a5bc4524a80 x1876716432742656/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:749/0 lens 504/0 e 0 to 0 dl 1789776569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776558.871644:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc4524a80 with x1876716432742656 ext(0->8) 00002000:00010000:3.0:1789776558.871650:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc4524a80 00000100:00100000:3.0:1789776558.871679:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1789776558.871690:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432742656:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789776558.872169:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4524000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1876716449568000:192.168.204.27@tcp:105: 00010000:00010000:2.0:1789776558.872197:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776558.872253:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432742528:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 6357us (6513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.872262:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1789776558.872770:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:2412:x1876716432742656:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 1080us (1442us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789776558.872778:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00002000:00100000:3.0:1789776558.872787:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a5bc4524a80 x1876716432742656/t4294967315(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:749/0 lens 504/448 e 0 to 0 dl 1789776569 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776558.872795:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc4524a80 with x1876716432742656 ext(0->8) 00002000:00010000:3.0:1789776558.872799:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc4524a80 00000100:00100000:0.0:1789776558.876225:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.876321:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742784 00000100:00100000:1.0:1789776558.876335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742784 00000100:00100000:1.0:1789776558.876414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:1.0:1789776558.876425:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12374:x1876716432742784:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789776558.883488:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789776558.883540:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789776558.883611:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789776558.883631:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5bc2581b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789776558.883637:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cf0f59c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc2581540 00000020:00080000:0.0:1789776558.883640:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cf0f59600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc3d86200 00000100:00100000:0.0:1789776558.883815:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12374:x1876716432742784:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 7386us (7597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776558.883825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:2.0:1789776558.884615:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776558.884634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449568256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789776558.884842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776558.884982:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449568256 00000100:00100000:1.0:1789776558.884991:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449568256 00000100:00100000:1.0:1789776558.885039:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789776558.885062:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449568256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789776558.885190:0:8528:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789776558.885194:0:8528:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789776560 00002000:00010000:1.0:1789776558.885196:0:8528:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789776558.885198:0:8528:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789776559 -> 1789776560 00002000:00010000:1.0:1789776558.885201:0:8528:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789776558.885241:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449568256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (399us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789776558.885249:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1789776558.885409:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cff49df80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789776558.885416:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449568256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789776558.885527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449568128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776558.885575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776558.885892:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449568128 00000100:00100000:2.0:1789776558.885898:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449568128 00000100:00100000:2.0:1789776558.885979:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776558.885987:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449568128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789776558.886005:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1789776558.886034:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd2ac, atime: 0x0, ctime: 0x6aadd2ac, blocks: 0x8 00010000:00010000:2.0:1789776558.886230:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.886250:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789776558.886254:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776558.886260:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.886278:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.886288:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.886296:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.886322:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776558.886472:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776558.886480:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.886489:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776558.886516:0:7925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.886535:0:7925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.886553:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.886572:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d06ef862/0xf13b8042cb8856b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.886592:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776558.886594:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776558.886596:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776558.886778:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449568128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 791us (1201us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789776558.886786:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1789776558.886829:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5bc3f1fb80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789776558.886834:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449568128:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789776558.887230:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887247:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887253:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887258:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.887263:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887269:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887281:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a5cf512ca00) 00010000:00010000:3.0:1789776558.887284:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776558.887288:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887293:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9000/0xf13b8042cb8853d6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887308:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887314:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887320:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887325:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f8200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.887332:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887338:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887346:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776558.887348:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776558.887350:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887356:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8200/0xf13b8042cb8853dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887368:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887372:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887377:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887382:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.887384:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789776558.887573:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789776558.887625:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789776558.887949:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887960:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc2122800) 00010000:00010000:3.0:1789776558.887963:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:1.0:1789776558.887971:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789776558.887976:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.887982:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb88541c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888007:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888014:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888019:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888023:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.888026:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888031:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888039:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776558.888115:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776558.888120:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888125:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88551f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888137:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888142:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888154:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888158:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.888161:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888167:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888175:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776558.888177:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776558.888179:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888184:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb885542 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888194:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888198:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888203:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888207:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.888210:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888225:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888233:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776558.888235:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776558.888237:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888243:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885588 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888254:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888259:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888265:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888269:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdea00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776558.888271:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888276:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888282:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:3.0:1789776558.888284:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789776558.888287:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.888302:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdea00/0xf13b8042cb88568b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.890853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.891375:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432742912 00000100:00100000:1.0:1789776558.891386:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432742912 00000100:00100000:1.0:1789776558.891774:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1789776558.891788:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:2411:x1876716432742912:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789776558.894787:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1789776558.894806:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789776558.896418:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432742912:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 4620us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.896449:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:0.0:1789776558.906273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.906849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743168 00000100:00100000:1.0:1789776558.906861:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743168 00000100:00100000:1.0:1789776558.906974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:1.0:1789776558.906985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12374:x1876716432743168:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.907055:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776558.907083:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a28 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.907104:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.907110:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776558.907142:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.907157:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.907167:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776558.907296:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa0d3cf6 reply state 00000000319a03c7 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.907308:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.907314:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.907317:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776558.907335:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776558.907467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:12374:x1876716432743168:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 483us (1203us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789776558.907475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:0.0:1789776558.917230:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776558.917339:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743296 00000100:00100000:2.0:1789776558.917349:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743296 00000100:00100000:2.0:1789776558.917427:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1789776558.917437:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432743296:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789776558.917839:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789776558.917844:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789776560 -> 1789776558 00002000:00010000:3.0:1789776558.917846:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789776556 00002000:00010000:3.0:1789776558.917848:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789776560 -> 1789776558 00002000:00010000:3.0:1789776558.917850:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789776558.917931:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432743296:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 493us (708us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789776558.917940:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1789776558.920934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776558.921137:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743552 00000100:00100000:1.0:1789776558.921147:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743552 00000100:00100000:1.0:1789776558.921240:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:1.0:1789776558.921251:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:12374:x1876716432743552:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789776558.921325:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.921344:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 21 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.921354:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.921403:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 21 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.921417:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 21 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.921432:0:13443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449568384:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776558.921570:0:13443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776558.924521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.924652:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743680 00000100:00100000:3.0:1789776558.924675:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743680 00010000:00010000:3.0:1789776558.924720:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 22 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776558.924761:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:3.0:1789776558.924771:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:2411:x1876716432743680:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776558.924784:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776558.924790:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 22 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.924802:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 22 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.924823:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:3.0:1789776558.924840:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.924850:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.924858:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.924878:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776558.924931:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:2411:x1876716432743680:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 161us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.924938:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00010000:00010000:1.0:1789776558.925724:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf400/0xf13b8042cb885684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a1a expref: 21 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.925748:0:13443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13443:1876716449568384:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776558.925786:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925797:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925804:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925846:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925855:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925862:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925868:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.925873:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925881:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925893:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.925896:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789776558.925900:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.925907:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.925972:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12374:x1876716432743552:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 4721us (5047us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789776558.925980:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:2.0:1789776558.930153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.930689:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743808 00000100:00100000:0.0:1789776558.930701:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743808 00000100:00100000:0.0:1789776558.930765:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1789776558.930775:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2413:x1876716432743808:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.930825:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.930859:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.930868:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776558.930873:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776558.930877:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.930915:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.930931:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.930946:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449568512:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776558.931050:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776558.934298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776558.934419:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432743936 00000100:00100000:2.0:1789776558.934429:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432743936 00010000:00010000:2.0:1789776558.934470:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 9 pid: 8432 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776558.934545:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:2.0:1789776558.934568:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432743936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776558.934585:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776558.934609:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 9 pid: 8432 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.934622:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 9 pid: 8432 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.934649:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776558.934654:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776558.934669:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.934679:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776558.934716:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776558.934768:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432743936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 215us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.934776:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00010000:00010000:0.0:1789776558.936318:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec5a53b4/0xf13b8042cb8856ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a36 expref: 8 pid: 8432 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.936339:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1876716449568512:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776558.936362:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936374:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936410:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936438:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936447:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936455:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936462:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdfe00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776558.936466:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936475:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936546:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.936966:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82ed577/0xf13b8042cb8856ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.937411:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2413:x1876716432743808:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 6635us (7265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776558.937422:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1789776558.943968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.944037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744192 00000100:00100000:0.0:1789776558.944059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744192 00000100:00100000:0.0:1789776558.944124:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:0.0:1789776558.944136:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12374:x1876716432744192:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789776558.944227:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.944247:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 20 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.944257:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.944298:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 20 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.944313:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 20 pid: 13443 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.944327:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449568640:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776558.944861:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776558.948575:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449568640:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776558.948634:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.950061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.951140:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744320 00000100:00100000:3.0:1789776558.951151:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744320 00010000:00010000:3.0:1789776558.951194:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 21 pid: 13443 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776558.951228:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1789776558.951238:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:2412:x1876716432744320:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776558.951254:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776558.951261:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 21 pid: 13443 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951274:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 21 pid: 13443 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951297:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9400/0xf13b8042cb885518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab59bf expref: 21 pid: 13443 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951336:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:3.0:1789776558.951342:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951353:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951360:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.951401:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776558.951868:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.951877:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.952070:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.952082:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.952089:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.952118:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.952132:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.952145:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449568768:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776558.952302:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:2412:x1876716432744320:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1064us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.952311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:0.0:1789776558.952776:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776558.957211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.957901:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744448 00000100:00100000:3.0:1789776558.957912:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744448 00010000:00010000:3.0:1789776558.957955:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776558.957992:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:3.0:1789776558.958000:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:2411:x1876716432744448:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776558.958016:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776558.958022:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.958233:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 21 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.958286:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:3.0:1789776558.958293:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.958303:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.958312:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.958335:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776558.958489:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:2411:x1876716432744448:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 488us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.958523:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00010000:00010000:0.0:1789776558.958733:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a21 expref: 20 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.958750:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449568768:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776558.958778:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.958788:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.958793:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776558.958904:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789776558.959264:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789776558.959310:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789776558.959408:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1876716449568896:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789776558.959462:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776558.959589:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776558.959994:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449568896 00000100:00100000:3.0:1789776558.960001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449568896 00000100:00100000:3.0:1789776558.960242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789776558.960251:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1876716449568896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789776558.960350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1876716449568896:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.960356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789776558.960481:0:6518:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789776558.960488:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cff49df80, transno 4294967316 00000100:00100000:1.0:1789776558.960530:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1876716449568896:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789776558.960701:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1789776558.960752:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3f1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1876716449569024:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789776558.960785:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776558.960803:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca180 going to sleep for 11 seconds 00000100:00100000:0.0:1789776558.961296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569024 00000100:00100000:0.0:1789776558.961302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569024 00000100:00100000:0.0:1789776558.961341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789776558.961349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876716449569024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789776558.961755:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1876716449569024:12345-0@lo:1000:mdt00_002.0 Request processed in 406us (968us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789776558.961764:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789776558.961849:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3f1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1876716449569024:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789776558.961890:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961899:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961906:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961913:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.961917:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961926:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961958:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:1.0:1789776558.961962:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776558.961967:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.961974:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8856d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962001:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962007:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962013:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962018:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776558.962020:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962026:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962034:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:1.0:1789776558.962036:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776558.962039:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88560d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962153:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962167:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 23 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962175:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962203:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 23 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776558.962218:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 23 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.962230:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449569152:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776558.962290:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776558.972069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776558.972213:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744576 00000100:00100000:0.0:1789776558.972235:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744576 00010000:00010000:0.0:1789776558.972279:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 24 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.972323:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:0.0:1789776558.972333:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:2412:x1876716432744576:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776558.972363:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776558.972370:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 24 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.972384:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 24 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.972423:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776558.972428:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.972439:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.972446:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.972466:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776558.972550:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:2412:x1876716432744576:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 218us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776558.972569:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00010000:00010000:1.0:1789776558.974912:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a05 expref: 23 pid: 10345 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776558.974936:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449569152:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776558.974964:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975118:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975126:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975138:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975165:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975172:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975177:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776558.975182:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975189:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975205:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776558.975208:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776558.975213:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975219:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8856df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975303:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975310:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975316:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975320:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776558.975328:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975335:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975344:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5cf512c700) 00010000:00010000:0.0:1789776558.975347:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776558.975350:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.975356:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb8856d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776558.976467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12374:x1876716432744192:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 32326us (32503us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789776558.976480:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 201 00000020:00080000:0.0:1789776558.976486:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789776558.980667:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776558.980676:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776558.981153:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789776558.981162:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776558.981203:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776558.981316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744832 00000100:00100000:3.0:1789776558.981326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744832 00000100:00100000:3.0:1789776558.981379:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1789776558.981405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc90b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12374:x1876716432744832:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789776558.982210:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789776558.982318:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1789776558.982358:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982375:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982401:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982410:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982434:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982441:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776558.982462:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789776558.982821:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc90b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:12374:x1876716432744832:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 1429us (1618us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789776558.982830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000020:00080000:0.0:1789776558.982835:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776558.982931:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776558.982940:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.982955:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdfe00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776558.982960:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.982968:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.982982:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:3.0:1789776558.982986:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789776558.982990:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.982997:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfe00/0xf13b8042cb8856e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776558.983010:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776558.983012:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776558.983014:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776559.139692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449569280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776559.139766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.140745:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776559.140760:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449569408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776559.140806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.140862:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569280 00000100:00100000:1.0:1789776559.140871:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569280 00000100:00100000:1.0:1789776559.140927:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569408 00000100:00100000:1.0:1789776559.140930:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569408 00000100:00100000:1.0:1789776559.140950:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789776559.140958:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449569280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776559.140988:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776559.141035:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449569280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.141042:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789776559.141061:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789776559.141067:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449569408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776559.141077:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776559.141106:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449569408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.141112:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1789776559.141130:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776559.141170:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449569408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776559.141204:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449569280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776559.141799:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449569664:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.141830:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449569792:0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.141840:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776559.141925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569664 00000100:00100000:2.0:1789776559.141931:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569664 00000100:00100000:2.0:1789776559.141968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789776559.141974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776559.142076:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449569920:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.144165:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.144231:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449570304:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.144786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.144842:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449569536:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.144877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.144936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449570048:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.144965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.144992:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449570560:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776559.145060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569536 00000100:00100000:1.0:1789776559.145068:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569536 00000100:00100000:1.0:1789776559.145124:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789776559.145133:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449569536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145188:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3646:x1876716449569536:12345-0@lo:400:kworker.0 Request processed in 56us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.145195:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789776559.145242:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449569536:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145270:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570304 00000100:00100000:1.0:1789776559.145273:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570304 00000100:00100000:1.0:1789776559.145304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570560 00000100:00100000:1.0:1789776559.145307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570560 00000100:00100000:1.0:1789776559.145322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789776559.145329:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449570304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449570304:12345-0@lo:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.145371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789776559.145398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789776559.145405:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449570560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449570560:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.145443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1789776559.145467:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776559.145470:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776559.145489:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449570560:0@lo:400:kworker.0 00010000:00080000:1.0:1789776559.145543:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc4525880 x1876716449570304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776559.145553:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449570304:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145588:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569792 00000100:00100000:1.0:1789776559.145591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569792 00000100:00100000:1.0:1789776559.145615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570048 00000100:00100000:1.0:1789776559.145617:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570048 00000100:00100000:1.0:1789776559.145629:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789776559.145634:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449569792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145670:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449569792:12345-0@lo:400:kworker.0 Request processed in 36us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.145676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789776559.145687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789776559.145693:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449570048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449570048:12345-0@lo:400:kworker.0 Request processed in 31us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.145729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789776559.145755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449570048:0@lo:400:kworker.0 00000100:00100000:1.0:1789776559.145778:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449569792:0@lo:400:kworker.0 00000100:00100000:2.0:1789776559.146450:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449569664:12345-0@lo:400:kworker.0 Request processed in 4473us (4606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776559.146460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789776559.150145:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449569664:0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.150164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449570176:0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.152458:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776559.152545:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449570688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.152664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776559.152861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776559.152882:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570176 00000100:00100000:3.0:1789776559.152884:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789776559.152890:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570176 00000100:00100000:3.0:1789776559.152911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776559.152942:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570688 00000100:00100000:2.0:1789776559.152946:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570688 00000100:00080000:3.0:1789776559.152948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776559.152952:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776559.152962:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449569920 00000100:00100000:2.0:1789776559.152965:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449569920 00000100:00100000:2.0:1789776559.152981:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789776559.152990:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449570176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776559.153058:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449570176:12345-0@lo:400:kworker.0 Request processed in 69us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776559.153078:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789776559.153096:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789776559.153102:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449570688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776559.153130:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449570688:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776559.153136:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789776559.153147:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789776559.153153:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449569920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776559.153179:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449569920:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776559.153184:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789776559.153285:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449569920:0@lo:400:kworker.0 00000100:00100000:3.0:1789776559.153320:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449570176:0@lo:400:kworker.0 00010000:00080000:3.0:1789776559.153342:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc4525180 x1876716449570688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776559.153353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449570688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.157229:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449570432 00000100:00100000:0.0:1789776559.157246:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449570432 00000100:00100000:0.0:1789776559.157317:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776559.157329:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449570432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776559.157451:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449570432:12345-0@lo:400:kworker.0 Request processed in 124us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776559.157460:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789776559.157537:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449570432:0@lo:400:kworker.0 00010000:00010000:0.0:1789776559.522831:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776559.805029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776559.805080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776559.805120:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432744960 00000100:00100000:0.0:1789776559.805132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432744960 00000100:00100000:3.0:1789776559.805196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776559.805210:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00100000:0.0:1789776559.805223:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432744960:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776559.805231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776559.805261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776559.805323:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745088 00000100:00100000:1.0:1789776559.805327:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745088 00000100:00100000:1.0:1789776559.805384:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745344 00000100:00100000:1.0:1789776559.805387:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745344 00000100:00100000:1.0:1789776559.805428:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:1.0:1789776559.805435:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432745088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776559.805540:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2412:x1876716432744960:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 320us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776559.805548:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 385 00000100:00100000:2.0:1789776559.805998:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745216 00000100:00100000:2.0:1789776559.806003:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745216 00000100:00100000:2.0:1789776559.806053:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:2.0:1789776559.806189:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432745216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1789776559.806323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776559.806356:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2412:x1876716432745088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 920us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776559.806366:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:1.0:1789776559.806394:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745472 00000100:00100000:1.0:1789776559.806398:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745472 00000100:00080000:3.0:1789776559.806414:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776559.806419:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776559.806426:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:1.0:1789776559.806436:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432745344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776559.806462:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:1.0:1789776559.806471:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432745344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776559.806475:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432745472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776559.806485:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 306 00000100:00100000:3.0:1789776559.806534:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432745472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 63us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776559.806541:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:2.0:1789776559.806670:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432745216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 485us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776559.806678:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00000040:00080000:0.0:1789776560.474289:0:14704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776560.474301:0:14704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776560.474329:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789776560.474335:0:14704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789776560.547052:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776560.601584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776560.601686:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745728 00000100:00100000:1.0:1789776560.601696:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745728 00000100:00100000:1.0:1789776560.601771:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:1.0:1789776560.601782:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:12392:x1876716432745728:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776560.601807:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776560.601827:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8856ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a3d expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.601933:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8856f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.601949:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8856f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.601961:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8856f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776560.601994:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789776560.602096:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb8856ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a3d expref: 27 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.602116:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8856f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a3d expref: 26 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.602125:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776560.602128:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776560.602132:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0e00, rc 0) 00000100:00100000:1.0:1789776560.602189:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12392:x1876716432745728:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 409us (615us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789776560.602197:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00080000:3.0:1789776560.602383:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776560.610141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776560.610178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432745856 00000100:00100000:3.0:1789776560.610188:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432745856 00000100:00100000:3.0:1789776560.610250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00100000:3.0:1789776560.610261:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12392:x1876716432745856:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1789776560.610333:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610350:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610385:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610400:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610408:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610414:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610488:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610519:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610538:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776560.610584:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610596:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610602:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610609:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610625:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776560.610630:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610637:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610649:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776560.610652:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776560.610656:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610663:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610675:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610681:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610687:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610692:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776560.610695:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610700:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610717:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc33da100) 00010000:00010000:3.0:1789776560.610720:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776560.610723:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610730:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610744:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610749:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610755:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610760:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776560.610762:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610768:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610774:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da700) 00010000:00010000:3.0:1789776560.610776:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776560.610778:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.610783:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776560.610871:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12392:x1876716432745856:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 611us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776560.610879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00100000:3.0:1789776560.660939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776560.660982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432746112 00000100:00100000:3.0:1789776560.660991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432746112 00000100:00100000:3.0:1789776560.661045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:3.0:1789776560.661054:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+26:12395:x1876716432746112:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776560.661072:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776560.661094:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a44 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661174:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661190:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661201:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661219:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661226:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661233:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661372:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661381:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661388:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776560.661396:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789776560.661472:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661479:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661485:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661512:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776560.661518:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661664:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661677:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776560.661681:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776560.661687:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661703:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb88571e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661716:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661722:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661727:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661732:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776560.661735:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661741:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661749:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc33da700) 00010000:00010000:3.0:1789776560.661752:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776560.661754:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661760:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661807:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661821:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.661837:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:3.0:1789776560.661839:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776560.661841:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d400, rc 0) 00000100:00100000:3.0:1789776560.661919:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12395:x1876716432746112:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 865us (987us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789776560.661927:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:0.0:1789776560.669207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.669249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432746240 00000100:00100000:0.0:1789776560.669258:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432746240 00000100:00100000:0.0:1789776560.669313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:0.0:1789776560.669325:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12395:x1876716432746240:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1789776560.669404:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669422:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669435:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669470:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669489:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669513:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669520:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776560.669526:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669534:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669546:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:0.0:1789776560.669549:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776560.669553:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.669560:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb88573a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776560.669629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12395:x1876716432746240:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 307us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776560.669637:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:2.0:1789776560.672452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.672591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432746496 00000100:00100000:0.0:1789776560.672601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432746496 00000100:00100000:0.0:1789776560.672722:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1789776560.672737:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12395:x1876716432746496:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776560.672974:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:12395:x1876716432746496:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 240us (527us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789776560.672990:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1789776560.701579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776560.701841:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432746752 00000100:00100000:1.0:1789776560.701851:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432746752 00000100:00100000:1.0:1789776560.701915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:1.0:1789776560.701925:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:11919:x1876716432746752:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776560.701951:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776560.701975:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885741 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a4b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.702082:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.702096:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.702137:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.702177:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.702191:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 30 pid: 6517 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776560.702205:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449570816:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776560.702303:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776560.704615:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449570816:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776560.704646:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776560.705704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776560.706832:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432746880 00000100:00100000:2.0:1789776560.706844:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432746880 00010000:00010000:2.0:1789776560.706890:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 31 pid: 6517 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776560.706956:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:2.0:1789776560.706966:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:2411:x1876716432746880:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776560.706983:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776560.706991:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 31 pid: 6517 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707004:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 31 pid: 6517 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707264:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88572c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a44 expref: 31 pid: 6517 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707282:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:2.0:1789776560.707288:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707298:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707306:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.707442:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776560.707515:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.707525:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776560.707548:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789776560.707680:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885741 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.707697:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.707718:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:1.0:1789776560.707721:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776560.707724:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0000, rc 0) 00000100:00100000:2.0:1789776560.707761:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:2411:x1876716432746880:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 794us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776560.707763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:11919:x1876716432746752:12345-192.168.204.27@tcp:101:bash.0 Request processed in 5837us (6194us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789776560.707780:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:2.0:1789776560.707782:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:0.0:1789776560.710801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776560.710929:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747008 00000100:00100000:3.0:1789776560.710938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747008 00000100:00100000:0.0:1789776560.711165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:0.0:1789776560.711177:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:11919:x1876716432747008:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1789776560.711203:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776560.711225:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb885756 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a52 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711257:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb88575d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711270:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb88575d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711280:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb88575d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711409:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb885756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a52 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711427:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb88575d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a52 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.711436:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:0.0:1789776560.711439:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776560.711442:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf600, rc 0) 00000100:00100000:0.0:1789776560.711659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:11919:x1876716432747008:12345-192.168.204.27@tcp:101:bash.0 Request processed in 483us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776560.711689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:3.0:1789776560.719861:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.720284:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747264 00000100:00100000:0.0:1789776560.720294:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747264 00000100:00100000:0.0:1789776560.720350:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:0.0:1789776560.720468:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:11919:x1876716432747264:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:0.0:1789776560.720738:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.720755:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.720767:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776560.720810:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789776560.720832:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029b498de reply state 00000000616f6611 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.720843:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.720850:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:0.0:1789776560.720853:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776560.720856:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789776560.720892:0:13443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789776560.720988:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11919:x1876716432747264:12345-192.168.204.27@tcp:36:bash.0 Request processed in 524us (1135us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789776560.720996:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 208 00000020:00080000:0.0:1789776560.721000:0:13443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789776560.723996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776560.724191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747392 00000100:00100000:1.0:1789776560.724201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747392 00000100:00100000:1.0:1789776560.724261:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:1.0:1789776560.724273:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+35:11919:x1876716432747392:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776560.724380:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776560.724403:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88576b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a59 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.724460:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88576b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a59 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.724476:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88576b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a59 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.724522:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:1.0:1789776560.724527:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776560.724530:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0c00, rc 0) 00000100:00100000:1.0:1789776560.724589:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:11919:x1876716432747392:12345-192.168.204.27@tcp:101:bash.0 Request processed in 317us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776560.724613:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:2.0:1789776560.727178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.727995:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747520 00000100:00100000:0.0:1789776560.728005:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747520 00000100:00100000:0.0:1789776560.728087:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1789776560.728099:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:11919:x1876716432747520:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1789776560.728117:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789776560.728143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776560.728150:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a60 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776560.728182:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd2ae, atime: 0x6aadd2ac, ctime: 0x6aadd2ae, blocks: 0x8 00010000:00010000:0.0:1789776560.728206:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1789776560.728210:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776560.728219:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.728236:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.728249:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfc00, rc 0) 00000100:00100000:0.0:1789776560.728313:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:11919:x1876716432747520:12345-192.168.204.27@tcp:101:bash.0 Request processed in 216us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776560.728320:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776560.737279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.737384:0:14615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747648 00000100:00100000:0.0:1789776560.737395:0:14615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747648 00002000:00010000:0.0:1789776560.737437:0:14615:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789776560.737442:0:14615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d4f800 with x1876716432747648 ext(0->18446744073709551615) 00002000:00010000:0.0:1789776560.737455:0:14615:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3d4f800. 00000100:00100000:0.0:1789776560.738682:0:14615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1789776560.738721:0:14615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432747648:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:0.0:1789776560.739000:0:14615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789776560.739004:0:14615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789776558 -> 1789776561 00002000:00010000:0.0:1789776560.739007:0:14615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789776556 -> 1789776556 00002000:00010000:0.0:1789776560.739009:0:14615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789776558 -> 1789776561 00002000:00010000:0.0:1789776560.739011:0:14615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789776560.739102:0:14615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432747648:12345-192.168.204.27@tcp:10:bash.0 Request processed in 389us (1831us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789776560.739111:0:14615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00002000:00010000:0.0:1789776560.739115:0:14615:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789776560.739118:0:14615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d4f800 with x1876716432747648 ext(0->18446744073709551615) 00002000:00010000:0.0:1789776560.739125:0:14615:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3d4f800. 00000100:00100000:3.0:1789776560.833784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776560.837659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.838089:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747776 00000100:00100000:0.0:1789776560.838100:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747776 00002000:00100000:0.0:1789776560.838162:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8a5cff49df80 x1876716432747776/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:751/0 lens 496/0 e 0 to 0 dl 1789776571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776560.838176:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff49df80 with x1876716432747776 ext(0->7) 00002000:00010000:0.0:1789776560.838182:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff49df80 00000100:00100000:0.0:1789776560.838214:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1789776560.838225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432747776:12345-192.168.204.27@tcp:4:bash.0 00000100:00100000:1.0:1789776560.839596:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432747904 00000100:00100000:1.0:1789776560.839605:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432747904 00000100:00100000:1.0:1789776560.839663:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1789776560.839674:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:2414:x1876716432747904:12345-192.168.204.27@tcp:16:kworker.0 00000100:00100000:3.0:1789776560.845618:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:2411:x1876716432747776:12345-192.168.204.27@tcp:4:bash.0 Request processed in 7382us (11834us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789776560.845638:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00002000:00100000:3.0:1789776560.845654:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8a5cff49df80 x1876716432747776/t4294967320(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:751/0 lens 496/448 e 0 to 0 dl 1789776571 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776560.845665:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5cff49df80 with x1876716432747776 ext(0->7) 00002000:00010000:3.0:1789776560.845674:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5cff49df80 00000100:00100000:0.0:1789776560.846008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776560.846451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432748032 00000100:00100000:1.0:1789776560.846459:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432748032 00000100:00100000:1.0:1789776560.846561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:1.0:1789776560.846582:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:12409:x1876716432748032:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1789776560.846658:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846675:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846690:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846709:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846716:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846722:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846804:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846829:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846837:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776560.846888:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846900:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846906:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846914:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846920:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776560.846924:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846932:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846959:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776560.846962:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776560.846968:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846974:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb885779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.846995:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847001:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847007:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847013:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776560.847016:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847022:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847031:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:1.0:1789776560.847033:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776560.847036:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847042:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb885780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847056:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847062:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847068:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847079:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776560.847082:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847088:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847095:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:1.0:1789776560.847097:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776560.847100:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776560.847104:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776560.847168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:12409:x1876716432748032:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 599us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776560.847176:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 210 00000001:00080000:0.0:1789776560.854338:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1789776560.854367:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:1.0:1789776560.854727:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2414:x1876716432747904:12345-192.168.204.27@tcp:16:kworker.0 Request processed in 15049us (17077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776560.854739:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1789776560.924639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.924848:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432748288 00000100:00100000:0.0:1789776560.924859:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432748288 00000100:00100000:0.0:1789776560.924937:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:0.0:1789776560.924948:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+36:12412:x1876716432748288:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776560.924983:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776560.925007:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb88578e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a67 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925085:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925101:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925112:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925133:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925142:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925149:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925272:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8857a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925282:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8857a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925289:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8857a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776560.925311:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789776560.925404:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925413:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925420:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925426:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776560.925431:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925439:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925451:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776560.925454:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776560.925458:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925465:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb885795 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925478:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.925483:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928199:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928206:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776560.928211:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928220:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928238:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776560.928241:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776560.928246:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928252:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88579c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928365:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb88578e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a67 expref: 39 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928383:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8857a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a67 expref: 38 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.928391:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:0.0:1789776560.928394:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789776560.928396:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf800, rc 0) 00000100:00100000:0.0:1789776560.928482:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12412:x1876716432748288:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3534us (3852us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789776560.932152:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:0.0:1789776560.936545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776560.936704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432748416 00000100:00100000:3.0:1789776560.936714:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432748416 00000100:00100000:3.0:1789776560.936789:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:3.0:1789776560.936798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12412:x1876716432748416:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1789776560.936866:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.936882:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.936892:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.936923:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776560.936936:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 38 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776560.936948:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449570944:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776560.937038:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776560.941286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776560.942210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432748672 00000100:00100000:2.0:1789776560.942220:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432748672 00000100:00100000:2.0:1789776560.942285:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776560.942295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:6646:x1876716432748672:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789776560.942660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:6646:x1876716432748672:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 365us (1382us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789776560.942668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776560.942723:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff459500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876716449570944:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776560.942747:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776560.948901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.948997:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432748800 00000100:00100000:0.0:1789776560.949006:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432748800 00010000:00010000:0.0:1789776560.949047:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 40 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776560.949093:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:0.0:1789776560.949103:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:2412:x1876716432748800:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776560.949119:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776560.949125:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 40 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949139:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 40 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949163:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885748 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a4b expref: 40 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949180:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:0.0:1789776560.949185:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949195:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949202:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776560.949250:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776560.949311:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:2412:x1876716432748800:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 209us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776560.949319:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00010000:00010000:2.0:1789776560.950280:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950292:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950333:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950340:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950346:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950368:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342da00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776560.950372:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950389:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950402:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:2.0:1789776560.950404:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776560.950409:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776560.950415:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb8857b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776560.950532:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12412:x1876716432748416:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 13692us (13956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776560.950542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:2.0:1789776560.960337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776560.960435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432749056 00000100:00100000:0.0:1789776560.960447:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432749056 00000100:00100000:0.0:1789776560.960546:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1789776560.960557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+38:12412:x1876716432749056:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776560.960779:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:12412:x1876716432749056:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 224us (452us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789776560.960786:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1789776561.064017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.064305:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432749312 00000100:00100000:2.0:1789776561.064317:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432749312 00000100:00100000:2.0:1789776561.064388:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:2.0:1789776561.064400:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+39:12423:x1876716432749312:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1789776561.064425:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776561.064448:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8857b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a6e expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064728:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064745:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064776:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064792:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064799:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064805:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064927:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8857cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064936:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8857cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.064943:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8857cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776561.064953:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789776561.065055:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065063:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065070:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065076:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776561.065236:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065246:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065260:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776561.065263:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776561.065267:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065342:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb8857bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065371:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065377:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065382:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065387:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776561.065390:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065396:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065405:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc1a87000) 00010000:00010000:2.0:1789776561.065407:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776561.065417:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065423:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065468:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8857b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a6e expref: 42 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065482:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8857cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a6e expref: 41 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.065488:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:2.0:1789776561.066262:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776561.066268:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3600, rc 0) 00000100:00100000:2.0:1789776561.066743:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:12423:x1876716432749312:12345-192.168.204.27@tcp:101:cat.0 Request processed in 2340us (2734us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789776561.066752:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:3.0:1789776561.073591:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.073795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432749568 00000100:00100000:0.0:1789776561.073806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432749568 00000100:00100000:0.0:1789776561.073872:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:0.0:1789776561.073883:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+41:12423:x1876716432749568:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:0.0:1789776561.074220:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:12423:x1876716432749568:12345-192.168.204.27@tcp:35:cat.0 Request processed in 338us (636us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789776561.074227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:3.0:1789776561.094831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.094966:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432749824 00000100:00100000:1.0:1789776561.094978:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432749824 00000100:00100000:1.0:1789776561.095045:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 214 00000100:00100000:1.0:1789776561.095057:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+42:12424:x1876716432749824:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:1.0:1789776561.095130:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789776561.095166:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88576b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a59 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095215:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8857cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a6e expref: 41 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095229:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8857a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a67 expref: 40 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095241:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb88575d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a52 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095251:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:1.0:1789776561.095256:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776561.095278:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095292:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095300:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095315:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095323:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095329:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095437:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095447:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095453:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776561.095871:0:13443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789776561.095883:0:13443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382340388941ns, next at 383340386238ns, rc = 0 00010000:00010000:1.0:1789776561.095928:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095938:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095945:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095952:0:13443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095959:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095964:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.095997:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776561.096015:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096041:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096048:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096054:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776561.096058:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096065:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096074:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:1.0:1789776561.096077:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789776561.096081:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096088:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8857e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096104:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096110:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096116:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096121:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776561.096131:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096138:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096146:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776561.096148:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776561.096151:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096156:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb8857db lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776561.096166:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec86526b reply state 0000000080502ef8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096176:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.096181:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:3.0:1789776561.096388:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776561.096395:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.096402:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776561.096406:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.096419:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.096427:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:3.0:1789776561.096430:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789776561.096433:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.096438:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb8857f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.096448:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776561.096450:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776561.096451:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776561.096702:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776561.096707:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776561.096832:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12424:x1876716432749824:12345-192.168.204.27@tcp:36:rm.0 Request processed in 1774us (2006us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789776561.096841:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 214 00000100:00100000:3.0:1789776561.175336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.175638:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750080 00000100:00100000:2.0:1789776561.175648:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750080 00000100:00100000:2.0:1789776561.175719:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:2.0:1789776561.175729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+40:12430:x1876716432750080:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776561.175756:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776561.175778:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8857f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a75 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175882:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175910:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175922:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175934:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175941:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.175947:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776561.176266:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789776561.176772:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176782:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176790:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176820:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176827:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176833:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176847:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776561.176851:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176859:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176873:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776561.176876:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776561.176881:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176887:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb8857fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776561.176901:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005672883 reply state 0000000096b09945 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176911:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176917:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:2.0:1789776561.176920:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776561.176922:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789776561.176953:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb8857f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176967:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.176986:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:2.0:1789776561.176989:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776561.176991:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3a00, rc 0) 00000100:00100000:2.0:1789776561.177106:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12430:x1876716432750080:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1378us (1780us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789776561.177114:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:3.0:1789776561.184178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.184271:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750208 00000100:00100000:1.0:1789776561.184282:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750208 00000100:00100000:1.0:1789776561.184370:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1789776561.184382:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2414:x1876716432750208:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776561.184401:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.184441:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a7c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776561.184466:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789776561.184488:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1789776561.184524:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776561.184534:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.184554:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.184568:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0a00, rc 0) 00000100:00100000:1.0:1789776561.184650:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2414:x1876716432750208:12345-192.168.204.27@tcp:101:bash.0 Request processed in 270us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.184658:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00080000:3.0:1789776561.191546:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776561.192585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.193397:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750336 00000100:00100000:1.0:1789776561.193408:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750336 00000100:00100000:1.0:1789776561.193475:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:1.0:1789776561.193487:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:12430:x1876716432750336:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776561.193527:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.193548:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a83 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.193581:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.193716:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776561.193722:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776561.193728:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 9 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.193767:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.193781:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.193795:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8528:1876716449571072:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776561.193929:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776561.207905:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8528:1876716449571072:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776561.207949:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 9 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.207971:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0000, rc 0) 00000100:00100000:1.0:1789776561.208040:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:12430:x1876716432750336:12345-192.168.204.27@tcp:101:bash.0 Request processed in 14555us (15461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.208049:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:2.0:1789776561.216633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.216723:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750464 00000100:00100000:3.0:1789776561.216734:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750464 00010000:00010000:3.0:1789776561.216776:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776561.216820:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:3.0:1789776561.216831:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432750464:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776561.216848:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776561.216873:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.216912:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.216943:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004ad7892/0xf13b8042cb88581a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a7c expref: 9 pid: 8434 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.216963:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776561.216967:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776561.216976:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.216986:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.217025:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776561.217040:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876716449571200:192.168.204.27@tcp:105: 00000100:00100000:3.0:1789776561.217137:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776561.219687:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876716449571200:192.168.204.27@tcp:105: 00010000:00010000:3.0:1789776561.219710:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776561.219768:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432750464:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2938us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.219778:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:0.0:1789776561.222184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.222549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750720 00000100:00100000:2.0:1789776561.222560:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750720 00000100:00100000:2.0:1789776561.222624:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1789776561.222634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+43:12430:x1876716432750720:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1789776561.222928:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:12430:x1876716432750720:12345-192.168.204.27@tcp:35:bash.0 Request processed in 295us (754us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789776561.222936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1789776561.453044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.453174:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432750848 00000100:00100000:1.0:1789776561.453184:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432750848 00000100:00100000:1.0:1789776561.453256:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:1.0:1789776561.453285:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+44:12446:x1876716432750848:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776561.453314:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.453350:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a8a expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453422:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453437:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453449:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776561.453540:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789776561.453545:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776561.453566:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453592:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a8a expref: 46 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453609:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a8a expref: 45 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.453618:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776561.453620:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776561.453624:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0a00, rc 0) 00000100:00100000:1.0:1789776561.453688:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:12446:x1876716432750848:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 407us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.453703:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:3.0:1789776561.464394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.464539:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751104 00000100:00100000:1.0:1789776561.464552:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751104 00000100:00100000:1.0:1789776561.464618:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1789776561.464629:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+45:12446:x1876716432751104:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776561.464654:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.464676:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885836 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a91 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.464793:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88583d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.464808:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.464819:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776561.464832:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776561.464951:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a91 expref: 48 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.464972:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88583d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a91 expref: 47 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.464981:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:1.0:1789776561.464984:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776561.464988:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0400, rc 0) 00000100:00100000:1.0:1789776561.465072:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:12446:x1876716432751104:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 445us (689us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789776561.465079:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:2.0:1789776561.472377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.472417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.472542:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751360 00000100:00100000:3.0:1789776561.472551:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751360 00000100:00100000:3.0:1789776561.472610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:3.0:1789776561.472620:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+47:12446:x1876716432751360:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776561.472642:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776561.472661:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb88584b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a98 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.472761:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.472775:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.472786:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776561.472798:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789776561.472893:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb88584b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a98 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.472910:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a98 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.472918:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:3.0:1789776561.472921:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776561.472924:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c000, rc 0) 00000100:00100000:3.0:1789776561.472988:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:12446:x1876716432751360:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 368us (619us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789776561.473011:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:0.0:1789776561.473542:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751488 00000100:00100000:0.0:1789776561.473547:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751488 00000100:00100000:0.0:1789776561.473586:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1789776561.473594:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+49:2412:x1876716432751488:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776561.473604:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776561.473618:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb88583d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a91 expref: 49 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.473639:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:0.0:1789776561.473643:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776561.473677:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:2412:x1876716432751488:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 84us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.473683:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:2.0:1789776561.482111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.482214:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751616 00000100:00100000:1.0:1789776561.482225:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751616 00000100:00100000:1.0:1789776561.482284:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1789776561.482297:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432751616:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:1.0:1789776561.482363:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.482386:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.482396:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776561.482401:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776561.482405:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.482445:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.482461:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 8 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.482476:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1876716449571328:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776561.482630:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776561.485442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.485661:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1876716449571328:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776561.485694:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776561.485894:0:14615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751744 00000100:00100000:0.0:1789776561.485901:0:14615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751744 00002000:00100000:0.0:1789776561.485947:0:14615:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a5bc3d6e680 x1876716432751744/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:752/0 lens 504/0 e 0 to 0 dl 1789776572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776561.485956:0:14615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d6e680 with x1876716432751744 ext(0->8) 00010000:00010000:0.0:1789776561.485963:0:14615:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 9 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.485977:0:14615:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 9 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776561.485986:0:14615:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5bc3d6e680 00000100:00100000:0.0:1789776561.486016:0:14615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1789776561.486025:0:14615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432751744:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:0.0:1789776561.487024:0:14615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432751744:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 993us (1586us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789776561.487035:0:14615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:0.0:1789776561.487046:0:14615:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a5bc3d6e680 x1876716432751744/t4294967309(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:752/0 lens 504/448 e 0 to 0 dl 1789776572 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776561.487071:0:14615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d6e680 with x1876716432751744 ext(0->8) 00010000:00010000:0.0:1789776561.487078:0:14615:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 11 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.487090:0:14615:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 11 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776561.487097:0:14615:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a5bc3d6e680 00000001:00080000:1.0:1789776561.489542:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789776561.489560:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789776561.490619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.491286:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432751872 00000100:00100000:3.0:1789776561.491296:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432751872 00010000:00010000:3.0:1789776561.491334:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 7 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776561.491393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:3.0:1789776561.491874:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432751872:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776561.491894:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789776561.491913:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789776561.491916:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789776562 00002000:00010000:3.0:1789776561.491919:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789776562 00002000:00010000:3.0:1789776561.491921:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789776562 00002000:00010000:3.0:1789776561.491924:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789776561.491930:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 7 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.491946:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 7 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.492044:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001618a709/0xf13b8042cb885821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a83 expref: 7 pid: 8528 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.492062:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776561.492067:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776561.492074:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.492098:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.492133:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776561.492298:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492310:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492332:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492353:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492362:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492369:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776561.492373:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492381:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492400:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.492407:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e532cc20/0xf13b8042cb885860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776561.492556:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432751872:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1152us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.492560:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+6:2411:x1876716432751616:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 10196us (10394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.492570:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:1.0:1789776561.492575:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1789776561.503570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.504159:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432752128 00000100:00100000:2.0:1789776561.504169:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432752128 00000100:00100000:2.0:1789776561.504225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1789776561.504236:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc90b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+48:12446:x1876716432752128:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:2.0:1789776561.504308:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a98 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776561.504547:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789776561.504580:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789776561.505016:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1789776561.505206:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.505225:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.505233:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.505269:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.505283:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 52 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776561.505298:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d6f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876716449571456:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776561.505456:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789776561.510123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.510213:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d6f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876716449571456:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776561.510242:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.510326:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432752256 00000100:00100000:1.0:1789776561.510333:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432752256 00010000:00010000:1.0:1789776561.510383:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 53 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.510422:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:1.0:1789776561.510431:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+53:2412:x1876716432752256:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776561.510446:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776561.510453:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 53 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510465:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 53 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510489:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3a00/0xf13b8042cb88580c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a75 expref: 53 pid: 6518 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510560:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:1.0:1789776561.510565:0:7458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510573:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510581:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.510599:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776561.510703:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.510711:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776561.510823:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789776561.510926:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789776561.511015:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449571584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789776561.511062:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.511087:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776561.511114:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449571584 00000100:00100000:0.0:1789776561.511118:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449571584 00000100:00100000:0.0:1789776561.511154:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789776561.511160:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449571584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789776561.511235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449571584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.511242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789776561.511274:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1789776561.511279:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1789776561.511292:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5bc3f1fb80, transno 4294967308 00000100:00100000:0.0:1789776561.511305:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449571584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789776561.511472:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1789776561.511578:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449571712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789776561.511601:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.511615:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776561.511635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449571712 00000100:00100000:0.0:1789776561.511638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449571712 00000100:00100000:0.0:1789776561.511659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789776561.511665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876716449571712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789776561.511756:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876716449571712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (153us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789776561.511763:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789776561.511790:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4527b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876716449571712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789776561.511817:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789776561.511840:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511849:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511855:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511869:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776561.511874:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511881:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511894:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:0.0:1789776561.511897:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789776561.511902:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.511907:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb885867 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789776561.511988:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789776561.512040:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789776561.512050:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382756556224ns, next at 383756554437ns, rc = 0 00000001:00080000:0.0:1789776561.512056:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789776561.512073:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5bc1a87000) 00010000:00010000:0.0:1789776561.512076:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789776561.512082:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885852 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a98 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.514335:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+56:2412:x1876716432752256:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3887us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.514361:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00080000:1.0:1789776561.514537:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776561.517124:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc90b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:12446:x1876716432752128:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 12876us (13550us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789776561.517138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000020:00080000:0.0:1789776561.517146:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789776561.517883:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.517985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432752384 00000100:00100000:0.0:1789776561.517994:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432752384 00000100:00100000:0.0:1789776561.518079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:0.0:1789776561.518092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+55:12446:x1876716432752384:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776561.518117:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776561.518140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88586e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5a9f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.518198:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88586e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a9f expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.518211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88586e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a9f expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.518228:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776561.518231:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776561.518234:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cde800, rc 0) 00000100:00100000:0.0:1789776561.518290:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+56:12446:x1876716432752384:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 201us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.518297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:3.0:1789776561.523370:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.523804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432752640 00000100:00100000:1.0:1789776561.523814:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432752640 00000100:00100000:1.0:1789776561.523872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1789776561.523881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+56:12446:x1876716432752640:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1789776561.524111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12446:x1876716432752640:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 231us (753us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789776561.524119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00010000:00010000:0.0:1789776561.570782:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776561.619372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.619543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432752768 00000100:00100000:3.0:1789776561.619554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432752768 00000100:00100000:3.0:1789776561.619624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:3.0:1789776561.619636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12456:x1876716432752768:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1789776561.619718:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.621532:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.621554:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.621580:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.621590:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.621640:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.623980:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624003:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624015:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776561.624084:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624100:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624107:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624113:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624119:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ca00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776561.624123:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624132:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624163:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776561.624181:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776561.624187:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624193:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb885875 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624212:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624218:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624224:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624228:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776561.624231:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624236:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624244:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:3.0:1789776561.624247:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776561.624250:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624256:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb88587c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624267:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624280:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624285:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624290:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776561.624293:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624299:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624309:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.624312:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776561.624315:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.624321:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776561.624446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12456:x1876716432752768:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 4807us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.624455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:2.0:1789776561.673915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.674368:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753024 00000100:00100000:1.0:1789776561.674377:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753024 00000100:00100000:1.0:1789776561.674445:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:1.0:1789776561.674883:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+57:12459:x1876716432753024:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776561.674909:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.675022:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88588a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5aa6 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675106:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675122:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675135:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675147:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675155:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675162:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675277:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675286:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675292:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776561.675302:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776561.675398:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675417:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675424:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675430:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776561.675435:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.675443:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676382:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:1.0:1789776561.676388:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776561.676395:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676402:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676419:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676425:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676430:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676436:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776561.676890:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676904:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676915:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:1.0:1789776561.676918:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776561.676922:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676939:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0400/0xf13b8042cb885898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.676994:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb88588a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aa6 expref: 60 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.677009:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88589f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aa6 expref: 59 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.677017:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776561.677019:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776561.677021:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:1.0:1789776561.677111:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12459:x1876716432753024:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 2657us (3206us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789776561.677120:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1789776561.685709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.685964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753152 00000100:00100000:0.0:1789776561.685975:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753152 00000100:00100000:0.0:1789776561.686042:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:0.0:1789776561.686053:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12459:x1876716432753152:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1789776561.686135:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686172:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686185:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686222:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686230:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686236:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686242:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776561.686246:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686254:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686265:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776561.686268:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776561.686272:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.686278:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776561.686543:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12459:x1876716432753152:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 489us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.686558:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:2.0:1789776561.699101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.699310:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753408 00000100:00100000:1.0:1789776561.699322:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753408 00000100:00100000:1.0:1789776561.699394:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1789776561.699404:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+59:12459:x1876716432753408:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1789776561.699658:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:12459:x1876716432753408:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 255us (568us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789776561.699666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1789776561.845637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.845696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753664 00000100:00100000:3.0:1789776561.845708:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753664 00000100:00100000:3.0:1789776561.845777:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:3.0:1789776561.845788:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+60:12469:x1876716432753664:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776561.845816:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776561.845838:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789776561.845870:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0a00/0xf13b8042cb88582f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a8a expref: 60 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.845902:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776561.845909:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776561.845923:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5aad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.846038:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.846053:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.846063:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776561.846076:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789776561.846204:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aad expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.846219:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aad expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.846228:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.846231:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776561.846234:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:3.0:1789776561.846641:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12469:x1876716432753664:12345-192.168.204.27@tcp:101:bash.0 Request processed in 854us (1025us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789776561.846662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:2.0:1789776561.850413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.850545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.850631:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753920 00000100:00100000:1.0:1789776561.850641:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753920 00000100:00100000:1.0:1789776561.850704:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 224 00000100:00100000:1.0:1789776561.850715:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12469:x1876716432753920:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1789776561.850740:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.850762:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb8858c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ab4 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850798:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850813:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850824:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850950:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb8858c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 63 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850970:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 62 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.850979:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776561.850989:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776561.850993:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ee00, rc 0) 00000100:00100000:1.0:1789776561.851060:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:12469:x1876716432753920:12345-192.168.204.27@tcp:101:bash.0 Request processed in 347us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.851066:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 224 00000100:00100000:3.0:1789776561.851310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432753792 00000100:00100000:3.0:1789776561.851316:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432753792 00000100:00100000:3.0:1789776561.851689:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1789776561.851698:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+62:2412:x1876716432753792:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776561.851710:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776561.851728:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aad expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.851740:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.851743:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776561.851783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:2412:x1876716432753792:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 87us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.851791:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1789776561.855762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.856710:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754176 00000100:00100000:0.0:1789776561.856724:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754176 00000100:00100000:0.0:1789776561.856791:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:0.0:1789776561.856801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+61:12469:x1876716432754176:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:0.0:1789776561.856857:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776561.856884:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb88589f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aa6 expref: 61 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.856992:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776561.856998:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776561.857296:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.857312:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.857322:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776561.857382:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789776561.857405:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000543b9492 reply state 00000000e6e3fe63 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.857417:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.857423:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776561.857425:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776561.857442:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776561.857985:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12469:x1876716432754176:12345-192.168.204.27@tcp:36:bash.0 Request processed in 1093us (2143us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789776561.857994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 225 00000020:00080000:0.0:1789776561.858000:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789776561.864633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.864928:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754304 00000100:00100000:3.0:1789776561.864938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754304 00000100:00100000:3.0:1789776561.864999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:3.0:1789776561.865009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+63:12469:x1876716432754304:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776561.865033:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776561.865054:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5abb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865142:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865184:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776561.865216:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789776561.865220:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776561.865239:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865280:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865298:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.865307:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.865310:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776561.865314:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c000, rc 0) 00000100:00100000:3.0:1789776561.865600:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12469:x1876716432754304:12345-192.168.204.27@tcp:101:bash.0 Request processed in 591us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.865607:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:1.0:1789776561.874708:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.874950:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754560 00000100:00100000:0.0:1789776561.874960:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754560 00000100:00100000:0.0:1789776561.875040:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1789776561.875052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+64:12469:x1876716432754560:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1789776561.875297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12469:x1876716432754560:12345-192.168.204.27@tcp:35:bash.0 Request processed in 247us (598us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789776561.875305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1789776561.942623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.942762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754688 00000100:00100000:3.0:1789776561.942773:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754688 00000100:00100000:3.0:1789776561.942837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:3.0:1789776561.942848:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+65:12475:x1876716432754688:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776561.942875:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776561.942896:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ac2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.942986:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.943001:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.943014:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776561.943072:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789776561.943076:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776561.943096:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.943121:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb8858ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac2 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.943141:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac2 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.943150:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776561.943153:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776561.943156:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ca00, rc 0) 00000100:00100000:3.0:1789776561.943225:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432754688:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 378us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.943232:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:1.0:1789776561.947054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776561.947158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754816 00000100:00100000:0.0:1789776561.947169:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754816 00000100:00100000:0.0:1789776561.947236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:0.0:1789776561.947246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432754816:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776561.947268:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776561.947290:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ac9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947370:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947385:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947396:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947427:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947435:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947441:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947565:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947575:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947583:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776561.947625:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789776561.947629:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776561.947649:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947662:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947671:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947677:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947695:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947701:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdfa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776561.947706:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947714:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947727:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:0.0:1789776561.947731:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776561.947735:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947741:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfa00/0xf13b8042cb885901 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947755:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947762:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947768:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947774:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776561.947776:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947793:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947802:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:0.0:1789776561.947804:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776561.947807:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947813:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf600/0xf13b8042cb885908 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947841:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb8858fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac9 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947855:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac9 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.947862:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:0.0:1789776561.947864:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776561.947867:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf800, rc 0) 00000100:00100000:0.0:1789776561.947942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12475:x1876716432754816:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 697us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.947950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:0.0:1789776561.953107:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.953182:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432754944 00000100:00100000:3.0:1789776561.953194:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432754944 00000100:00100000:3.0:1789776561.953267:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1789776561.953278:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:2414:x1876716432754944:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776561.953295:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776561.953324:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb88590f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac9 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.953362:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.953367:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776561.953436:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:2414:x1876716432754944:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 160us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.953445:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776561.961865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.961960:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755200 00000100:00100000:1.0:1789776561.961971:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755200 00000100:00100000:1.0:1789776561.962025:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:1.0:1789776561.962035:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432755200:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1789776561.962054:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776561.962073:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb885916 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ad0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.962177:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.962191:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.962200:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.962230:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.962243:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 67 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.962291:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10345:1876716449571840:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776561.962389:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789776561.967868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776561.967971:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755328 00000100:00100000:2.0:1789776561.967981:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755328 00010000:00010000:2.0:1789776561.968026:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 68 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776561.968071:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:2.0:1789776561.968082:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:2411:x1876716432755328:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776561.968098:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776561.968106:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 68 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.968120:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 68 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.968142:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:2.0:1789776561.968147:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.968158:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.968165:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.968205:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776561.968267:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:2411:x1876716432755328:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776561.968276:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00010000:00010000:1.0:1789776561.968592:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb8858e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5abb expref: 67 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776561.968611:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10345:1876716449571840:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776561.968634:0:10345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.968644:0:10345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.968649:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776561.968666:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789776561.968800:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb885916 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 68 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.968816:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 67 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.968823:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776561.968826:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776561.968829:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fe00, rc 0) 00000100:00100000:1.0:1789776561.968870:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12475:x1876716432755200:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 6837us (7016us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789776561.968884:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:0.0:1789776561.973293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.973476:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755584 00000100:00100000:3.0:1789776561.973487:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755584 00000100:00100000:2.0:1789776561.973989:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1789776561.974002:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12475:x1876716432755584:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:2.0:1789776561.974018:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776561.974057:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb88586e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a9f expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776561.974076:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:2.0:1789776561.974082:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776561.974145:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432755584:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 145us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776561.974153:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1789776561.981925:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776561.982158:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755712 00000100:00100000:1.0:1789776561.982169:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755712 00000100:00100000:1.0:1789776561.982356:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:1.0:1789776561.982368:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432755712:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:1.0:1789776561.982536:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.982559:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776561.982573:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776561.982679:0:13443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789776561.982784:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432755712:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 417us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.982793:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:0.0:1789776561.988473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776561.988545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755840 00000100:00100000:3.0:1789776561.988556:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755840 00000100:00100000:3.0:1789776561.988620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00100000:3.0:1789776561.988630:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+66:12475:x1876716432755840:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776561.988651:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776561.988671:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ad7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988726:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988737:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988755:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988776:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988791:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776561.988794:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776561.988798:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776561.988806:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342c400, rc 0) 00000100:00100000:3.0:1789776561.988884:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12475:x1876716432755840:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 255us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776561.988891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 231 00000040:00080000:2.0:1789776562.082829:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776562.082842:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776562.082873:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789776562.082885:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776562.083044:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449571968:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776562.083171:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cdb4c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776562.088952:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449571968:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776562.093687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.094117:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432755968 00000100:00100000:1.0:1789776562.094588:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432755968 00000100:00100000:1.0:1789776562.094716:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:1.0:1789776562.094726:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12476:x1876716432755968:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776562.094758:0:10345:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776562.094911:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12476:x1876716432755968:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 186us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.094919:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00080000:3.0:1789776562.099629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776562.103800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.103936:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432756096 00000100:00100000:1.0:1789776562.103961:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432756096 00000100:00100000:1.0:1789776562.104020:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:1.0:1789776562.104030:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12476:x1876716432756096:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789776562.104110:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104127:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104140:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104156:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104163:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104170:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104196:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104204:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104211:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776562.104262:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789776562.104266:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776562.104285:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104296:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104302:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104309:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104314:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776562.104319:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104336:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104349:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:1.0:1789776562.104352:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776562.104356:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104362:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb885939 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104376:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104381:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104386:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104397:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776562.104401:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104407:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104415:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8a5cc3eded00) 00010000:00010000:1.0:1789776562.104417:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776562.104420:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104427:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb885940 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104442:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104448:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104453:0:13443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104458:0:13443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217ea00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776562.104460:0:13443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104466:0:13443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104484:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776562.104486:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776562.104489:0:13443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.104611:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885947 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.104916:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12476:x1876716432756096:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 885us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.104925:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:2.0:1789776562.111973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.112053:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432756352 00000100:00100000:3.0:1789776562.112064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432756352 00000100:00100000:3.0:1789776562.112124:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:3.0:1789776562.112151:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+67:12476:x1876716432756352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.112174:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776562.112198:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb88594e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ade expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112322:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112351:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112385:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776562.112398:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789776562.112484:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112885:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112894:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112901:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.112905:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112913:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112927:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776562.112930:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789776562.112935:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112942:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb885955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.112985:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb88594e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ade expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.113009:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:3.0:1789776562.113012:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776562.113017:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb88594e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ade expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.113027:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342da00, rc 0) 00000100:00100000:3.0:1789776562.113156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432756352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1007us (1192us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789776562.113164:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:0.0:1789776562.121700:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.121816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432756480 00000100:00100000:1.0:1789776562.121827:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432756480 00000100:00100000:1.0:1789776562.121899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:1.0:1789776562.121910:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432756480:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776562.121951:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776562.122077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432756480:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 168us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.122085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:0.0:1789776562.129626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.129810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432756736 00000100:00100000:3.0:1789776562.129820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432756736 00000100:00100000:3.0:1789776562.129874:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:3.0:1789776562.129883:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432756736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.129906:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776562.129909:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789776562.129937:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ca00/0xf13b8042cb8858f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ac2 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.129957:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776562.129963:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776562.129976:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885963 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776562.130374:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789776562.131102:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88596a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.131185:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88596a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.131197:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88596a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.131258:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342da00/0xf13b8042cb885963 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ae5 expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.131275:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88596a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ae5 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.131283:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5bc33da700) 00010000:00010000:3.0:1789776562.131286:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776562.131289:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d400, rc 0) 00000100:00100000:3.0:1789776562.131365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12476:x1876716432756736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1482us (1749us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789776562.131373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1789776562.135608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.135744:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432756992 00000100:00100000:3.0:1789776562.135755:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432756992 00000100:00100000:3.0:1789776562.135828:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:3.0:1789776562.135839:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12476:x1876716432756992:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.135900:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776562.135931:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d400/0xf13b8042cb88596a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ae5 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.135952:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5bc33da700) 00010000:00010000:3.0:1789776562.135979:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776562.136001:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136016:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136027:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136043:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136050:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136057:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136108:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136116:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136122:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136344:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342c000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.136349:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136357:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136372:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776562.136375:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776562.136379:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136385:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c000/0xf13b8042cb885978 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136395:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136400:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136405:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136409:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.136412:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136417:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136423:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5d13a7ae (ffff8a5bc33dae00) 00010000:00010000:3.0:1789776562.136426:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776562.136428:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.136434:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88597f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5d13a7ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.136681:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432756992:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 842us (1083us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776562.136690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:0.0:1789776562.142018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.142133:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432757120 00000100:00100000:1.0:1789776562.142144:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432757120 00000100:00100000:1.0:1789776562.142208:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:1.0:1789776562.142220:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9a36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+68:12476:x1876716432757120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776562.142241:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776562.142265:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885986 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5aec expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142318:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142348:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142361:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142467:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb885986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 70 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142488:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 69 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.142546:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:1.0:1789776562.142549:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776562.142553:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217f000, rc 0) 00000100:00100000:1.0:1789776562.142610:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9a36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12476:x1876716432757120:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 393us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.142617:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:3.0:1789776562.145616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.145830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432757376 00000100:00100000:2.0:1789776562.145852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432757376 00000100:00100000:2.0:1789776562.145914:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:2.0:1789776562.145926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+69:12476:x1876716432757376:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776562.146019:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.146039:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.146051:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776562.146241:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789776562.146252:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383390758570ns, next at 384390755338ns, rc = 0 00000004:00010000:2.0:1789776562.146304:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e160ccdb reply state 00000000c1914d0f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.146318:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.146335:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:2.0:1789776562.146338:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789776562.146342:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776562.146447:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12476:x1876716432757376:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 521us (840us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789776562.146455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:0.0:1789776562.158210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.158336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432757504 00000100:00100000:3.0:1789776562.158347:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432757504 00000100:00100000:3.0:1789776562.158414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:3.0:1789776562.158426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+71:12476:x1876716432757504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.158456:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776562.158480:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5af3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.158601:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.158623:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.158644:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:3.0:1789776562.158648:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776562.158652:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256200, rc 0) 00000100:00100000:3.0:1789776562.158709:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+72:12476:x1876716432757504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 286us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.158718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:0.0:1789776562.171365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.171483:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432757632 00000100:00100000:1.0:1789776562.171518:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432757632 00000100:00100000:1.0:1789776562.171596:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:1.0:1789776562.171605:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432757632:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789776562.171894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776562.172982:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432757632:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 1368us (1617us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789776562.173012:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:1.0:1789776562.182340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.182460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432757888 00000100:00100000:0.0:1789776562.182475:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432757888 00000100:00100000:0.0:1789776562.182583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1789776562.182593:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+72:12476:x1876716432757888:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776562.182827:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+73:12476:x1876716432757888:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 235us (510us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789776562.182835:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1789776562.189650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.189750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758144 00000100:00100000:2.0:1789776562.189761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758144 00000100:00100000:2.0:1789776562.189836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:2.0:1789776562.189846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+73:12476:x1876716432758144:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776562.189990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+73:12476:x1876716432758144:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 144us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.189998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:1.0:1789776562.193237:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.193405:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758272 00000100:00100000:0.0:1789776562.193415:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758272 00000100:00100000:0.0:1789776562.193479:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:0.0:1789776562.193521:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+73:12476:x1876716432758272:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776562.193543:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776562.193568:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8859a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5afa expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193652:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193669:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193695:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776562.193749:0:13443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776562.193769:0:13443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193934:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde400/0xf13b8042cb8859a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5afa expref: 75 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193954:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5afa expref: 74 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.193964:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:0.0:1789776562.193968:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789776562.193972:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cde800, rc 0) 00000100:00100000:2.0:1789776562.194445:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+74:12476:x1876716432758272:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 954us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.194453:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:1.0:1789776562.198959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.199056:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758400 00000100:00100000:0.0:1789776562.199065:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758400 00000100:00100000:0.0:1789776562.199122:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:0.0:1789776562.199144:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432758400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776562.199165:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776562.199189:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b01 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776562.199216:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2b3, blocks: 0x0 00010000:00010000:0.0:1789776562.199237:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1789776562.199241:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776562.199264:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.199285:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.199298:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfa00, rc 0) 00000100:00100000:0.0:1789776562.199373:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432758400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 242us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776562.199380:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1789776562.211236:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449572096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776562.211317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776562.212066:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449572224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776562.212109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776562.212285:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449572096 00000100:00100000:3.0:1789776562.212308:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449572096 00000100:00100000:3.0:1789776562.212377:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449572224 00000100:00100000:3.0:1789776562.212381:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449572224 00000100:00100000:3.0:1789776562.212399:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789776562.212408:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449572096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776562.212441:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776562.212525:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449572096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.212533:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789776562.212551:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789776562.212557:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449572224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776562.212574:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789776562.212609:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449572224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.212615:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789776562.212653:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449572224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776562.213003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449572096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776562.213603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.213690:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758656 00000100:00100000:2.0:1789776562.213697:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758656 00000100:00100000:2.0:1789776562.213754:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:2.0:1789776562.213765:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+74:12476:x1876716432758656:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776562.213969:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+74:12476:x1876716432758656:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 206us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.213978:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:2.0:1789776562.219361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.219460:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758784 00000100:00100000:1.0:1789776562.219471:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758784 00000100:00100000:1.0:1789776562.219559:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:1.0:1789776562.219571:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:12476:x1876716432758784:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776562.219593:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776562.219615:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b08 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.219650:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.219659:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776562.219664:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776562.219669:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 10 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.219702:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.219734:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 10 pid: 8433 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.219748:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8528:1876716449572352:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776562.221301:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc33fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776562.232650:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8528:1876716449572352:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776562.232688:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 10 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.232708:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ea00, rc 0) 00000100:00100000:1.0:1789776562.232848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.232912:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432758912 00000100:00100000:0.0:1789776562.232920:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432758912 00010000:00010000:0.0:1789776562.232951:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 11 pid: 8433 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.232985:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:0.0:1789776562.232994:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432758912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776562.233008:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776562.233048:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 11 pid: 8433 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.233061:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 11 pid: 8433 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.233085:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020d9c7ac/0xf13b8042cb8859b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b01 expref: 11 pid: 8433 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.233117:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776562.233122:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776562.233145:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 10 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.233156:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 10 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.233192:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 10 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.233206:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1876716449572480:192.168.204.27@tcp:105: 00000100:00100000:2.0:1789776562.233267:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+10:12476:x1876716432758784:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 13698us (13917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.233288:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:0.0:1789776562.241705:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789776562.253641:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1876716449572480:192.168.204.27@tcp:105: 00010000:00010000:0.0:1789776562.253670:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776562.253796:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432758912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 20801us (20946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776562.253808:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:2.0:1789776562.255366:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.255541:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759040 00000100:00100000:3.0:1789776562.255550:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759040 00002000:00100000:3.0:1789776562.255600:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8a5bc3d1c380 x1876716432759040/t0(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:753/0 lens 504/0 e 0 to 0 dl 1789776573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776562.255610:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d1c380 with x1876716432759040 ext(0->12) 00002000:00010000:3.0:1789776562.255616:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3d1c380 00000100:00100000:3.0:1789776562.255652:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1789776562.255662:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2411:x1876716432759040:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789776562.256795:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2411:x1876716432759040:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 1130us (1431us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789776562.256813:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00002000:00100000:3.0:1789776562.256823:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8a5bc3d1c380 x1876716432759040/t4294967322(0) o4->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:753/0 lens 504/448 e 0 to 0 dl 1789776573 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776562.256833:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3d1c380 with x1876716432759040 ext(0->12) 00002000:00010000:3.0:1789776562.256837:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3d1c380 00000100:00100000:2.0:1789776562.266993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.267080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759168 00000100:00100000:3.0:1789776562.267089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759168 00000100:00100000:3.0:1789776562.267152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:3.0:1789776562.267174:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+74:12476:x1876716432759168:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789776562.275988:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789776562.276012:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789776562.276054:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789776562.276068:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5cf5c0bd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789776562.276073:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cc814f500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cf5c0b3c0 00000020:00080000:1.0:1789776562.276076:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cc814ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc3d2f000 00000004:00080000:1.0:1789776562.276109:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789776562.276135:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5cf5dca300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789776562.276138:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc3e1b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cf5dca840 00000020:00080000:1.0:1789776562.276141:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5bc3e1b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc3d2fc00 00000020:00080000:1.0:1789776562.276150:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789776562.276166:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789776562.276229:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1789776562.276306:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276319:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276340:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276347:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276351:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276358:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276375:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a5cf512cf00) 00010000:00010000:2.0:1789776562.276378:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.276384:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276390:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0200/0xf13b8042cb8856bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276421:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276427:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276448:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276453:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdec00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276456:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276462:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276470:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a5bc33da100) 00010000:00010000:2.0:1789776562.276472:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.276475:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276480:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb885764 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276544:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276551:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276557:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276562:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276564:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276581:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276589:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:2.0:1789776562.276592:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.276595:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.276600:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789776562.276600:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1a00/0xf13b8042cb8857e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276613:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276619:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276625:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276630:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276632:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276638:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276645:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5cc3ede200) 00010000:00010000:2.0:1789776562.276647:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.276650:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276662:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2200/0xf13b8042cb885805 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.276673:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449572608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789776562.276680:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276685:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276690:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276694:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276697:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276702:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276709:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:2.0:1789776562.276711:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.276713:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276718:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb8858d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276728:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276733:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.276740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776562.276744:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276750:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.276752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276758:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276765:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:2.0:1789776562.276767:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789776562.276770:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.276775:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2a00/0xf13b8042cb885994 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.276783:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449572736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776562.276804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776562.276944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12476:x1876716432759168:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 9781us (9961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.276954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:2.0:1789776562.276957:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449572608 00000100:00100000:2.0:1789776562.276965:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449572608 00000100:00100000:3.0:1789776562.276983:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449572736 00000100:00100000:3.0:1789776562.276986:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449572736 00000100:00100000:3.0:1789776562.277009:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776562.277017:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449572736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789776562.277119:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789776562.277122:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789776563 00002000:00010000:3.0:1789776562.277124:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789776562.277144:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789776563 -> 1789776563 00002000:00010000:3.0:1789776562.277146:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:0.0:1789776562.278421:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776562.278437:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776562.278452:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449572864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776562.278522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776562.278536:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1876716449572736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1518us (1729us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789776562.278545:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789776562.279959:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1789776562.279971:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1789776562.280030:0:3643:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8a5bc3edd500 x1876716449572736/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789776578 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789776562.280043:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5bc3edd500/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789776562.280049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449572736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776562.283851:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449572864 00000100:00100000:3.0:1789776562.283867:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449572864 00000100:00100000:2.0:1789776562.283906:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776562.283953:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449572608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789776562.283991:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789776562.284019:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.284044:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.284074:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789776562.284078:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776562.284084:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.284122:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.284152:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 10 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776562.284168:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449572992:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776562.284244:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789776562.284248:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cdb4c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776562.284252:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449572864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789776562.284266:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789776562.284294:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd2b2, atime: 0x6aadd2b2, ctime: 0x6aadd2b2, blocks: 0x8 00010000:00010000:3.0:1789776562.284300:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.284309:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1789776562.284312:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776562.284317:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.285395:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.285407:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.285415:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.285466:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789776562.285664:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1876716449572864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1411us (7139us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789776562.285672:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00080000:3.0:1789776562.285719:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5bc4569180/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789776562.285725:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449572864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789776562.285819:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776562.285826:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.285835:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776562.285840:0:7925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.285850:0:7925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.285879:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.285887:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb8859c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.285908:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776562.285910:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776562.285912:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776562.291031:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.291118:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759296 00000100:00100000:2.0:1789776562.291128:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759296 00000100:00100000:2.0:1789776562.291193:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1789776562.291203:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2411:x1876716432759296:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789776562.292046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.292146:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449572992:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776562.292182:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.292375:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759424 00000100:00100000:1.0:1789776562.292380:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759424 00010000:00010000:1.0:1789776562.292414:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 12 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.292465:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:1.0:1789776562.292473:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+12:2412:x1876716432759424:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776562.292486:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776562.292515:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 12 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.292528:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 12 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.292554:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885772 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a60 expref: 12 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.292572:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776562.292576:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776562.292582:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.292593:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.292624:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776562.292688:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+11:2412:x1876716432759424:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 215us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.292695:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00010000:00010000:3.0:1789776562.292750:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.292759:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.292768:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.292776:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.292797:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789776562.292972:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876716449572608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9025us (16231us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789776562.292984:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:0.0:1789776562.293111:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5bc3eded80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1789776562.293119:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449572608:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789776562.293152:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776562.293158:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776562.293260:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:1.0:1789776562.293265:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc0bf0420) 00000001:00080000:2.0:1789776562.293271:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:1.0:1789776562.293272:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.293285:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.293300:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.293307:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb8859be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.293334:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776562.293336:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776562.293338:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776562.293427:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432759296:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 2225us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.293434:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1789776562.296242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.296346:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759680 00000100:00100000:1.0:1789776562.296357:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759680 00000100:00100000:1.0:1789776562.296417:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1789776562.296428:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12476:x1876716432759680:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776562.296483:0:13443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776562.296547:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde800/0xf13b8042cb8859a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5afa expref: 22 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.296586:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:1.0:1789776562.296592:0:13443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776562.296639:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.296653:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.296664:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776562.296808:0:13443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009a15610 reply state 00000000d8f758fe transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.296820:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.296826:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:1.0:1789776562.296833:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789776562.296836:0:13443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776562.296927:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:12476:x1876716432759680:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 500us (697us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789776562.296934:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1789776562.302978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.303066:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432759808 00000100:00100000:0.0:1789776562.303076:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432759808 00000100:00100000:0.0:1789776562.303130:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1789776562.303140:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432759808:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789776562.303289:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789776562.303293:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789776563 -> 1789776563 00002000:00010000:0.0:1789776562.303296:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789776562 00002000:00010000:0.0:1789776562.303298:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789776563 -> 1789776563 00002000:00010000:0.0:1789776562.303301:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789776562.303449:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432759808:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 309us (482us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789776562.303457:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1789776562.319173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.319275:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760064 00000100:00100000:3.0:1789776562.319287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760064 00000100:00100000:3.0:1789776562.319360:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:3.0:1789776562.319370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:12476:x1876716432760064:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.319784:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.319972:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 23 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.319983:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.320017:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 23 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.320031:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 23 pid: 13443 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.320045:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449573120:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776562.320185:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776562.323697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.323782:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760192 00000100:00100000:1.0:1789776562.323799:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760192 00010000:00010000:1.0:1789776562.323835:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 24 pid: 13443 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.323883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1789776562.323891:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:2411:x1876716432760192:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776562.323906:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776562.323912:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 24 pid: 13443 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.323924:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 24 pid: 13443 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.323945:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:1.0:1789776562.323950:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.323960:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.323967:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.323983:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776562.324027:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+24:2411:x1876716432760192:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.324033:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00010000:00010000:3.0:1789776562.326513:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb88598d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5aec expref: 23 pid: 13443 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.326568:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449573120:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776562.326593:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326607:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326613:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326658:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326666:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326673:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326679:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.326684:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326692:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:3.0:1789776562.326712:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789776562.326717:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.326729:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.326817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12476:x1876716432760064:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 7447us (7655us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789776562.326826:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1789776562.328929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.329003:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760320 00000100:00100000:3.0:1789776562.329012:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760320 00000100:00100000:3.0:1789776562.329068:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:3.0:1789776562.329078:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2411:x1876716432760320:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.329119:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.329139:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.329149:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776562.329153:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776562.329158:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.329191:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 8 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.329206:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 8 pid: 8528 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.329241:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449573248:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776562.329383:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776562.333313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.333424:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876716449573248:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776562.333447:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760448 00010000:00010000:3.0:1789776562.333451:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.333453:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760448 00010000:00010000:0.0:1789776562.333487:0:7458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 9 pid: 8528 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.333705:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:0.0:1789776562.333717:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+9:2412:x1876716432760448:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776562.333748:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776562.333774:0:7458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 9 pid: 8528 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.333798:0:7458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 9 pid: 8528 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.333827:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c13c2ea/0xf13b8042cb8859b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b08 expref: 9 pid: 8528 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.333853:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776562.333858:0:7458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776562.333864:0:7458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.333875:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.333909:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776562.333966:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.333967:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432760448:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 253us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776562.333975:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00010000:00010000:3.0:1789776562.333976:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.333995:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334004:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334017:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334024:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776562.334028:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334052:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334064:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.334071:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb8859da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.334116:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432760320:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 5040us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776562.334123:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1789776562.335977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776562.336044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760704 00000100:00100000:3.0:1789776562.336052:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760704 00000100:00100000:3.0:1789776562.336157:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:3.0:1789776562.336167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:12476:x1876716432760704:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789776562.336261:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.336280:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 22 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.336290:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.336335:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 22 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.336361:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 22 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.336375:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573376:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776562.336463:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776562.342876:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573376:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776562.342909:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.349412:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.349548:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760832 00000100:00100000:1.0:1789776562.349558:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760832 00010000:00010000:1.0:1789776562.349602:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 23 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.349654:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:1.0:1789776562.349663:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:2412:x1876716432760832:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776562.349679:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776562.349687:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 23 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349700:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 23 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349727:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ee00/0xf13b8042cb8858d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ab4 expref: 23 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349743:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776562.349751:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349760:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349768:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349776:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.349879:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776562.349949:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:2412:x1876716432760832:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 284us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.349964:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00010000:00010000:3.0:1789776562.350386:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350396:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350619:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350631:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350640:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350670:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.350683:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 22 pid: 6518 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.350705:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573504:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776562.350760:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776562.357472:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573504:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776562.357885:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.359367:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.359516:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432760960 00000100:00100000:2.0:1789776562.359526:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432760960 00010000:00010000:2.0:1789776562.359571:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 23 pid: 6518 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776562.359613:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:2.0:1789776562.359624:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:2411:x1876716432760960:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776562.359655:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776562.359663:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 23 pid: 6518 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359677:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 23 pid: 6518 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359704:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb88599b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5af3 expref: 23 pid: 6518 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359721:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:2.0:1789776562.359727:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359736:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359745:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.359782:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776562.359847:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:2411:x1876716432760960:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.359855:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00010000:00010000:3.0:1789776562.360026:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.360035:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776562.360305:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789776562.361187:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789776562.361228:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789776562.361311:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876716449573632:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789776562.362166:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776562.362275:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776562.363586:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449573632 00000100:00100000:0.0:1789776562.363615:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449573632 00000100:00100000:0.0:1789776562.364169:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789776562.364187:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876716449573632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789776562.364433:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876716449573632:12345-0@lo:1000:mdt00_000.0 Request processed in 254us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776562.364441:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789776562.365281:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789776562.365288:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5bc3edd500, transno 4294967323 00000100:00100000:3.0:1789776562.365310:0:6516:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8a5bc3eded80 x1876716449572608/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789776578 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776562.365392:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876716449573632:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789776562.365664:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789776562.365738:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876716449573760:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789776562.365784:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776562.365859:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776562.365898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449573760 00000100:00100000:1.0:1789776562.365905:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449573760 00000100:00100000:1.0:1789776562.366041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789776562.366051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876716449573760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789776562.366185:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876716449573760:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (399us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789776562.366191:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789776562.366250:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876716449573760:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789776562.366290:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366315:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366339:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366346:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257a00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.366351:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366359:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:3.0:1789776562.366378:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776562.366383:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366389:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb8859e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366414:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366420:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366426:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366431:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.366442:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366448:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366456:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776562.366458:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776562.366465:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366477:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366486:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.366546:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.366559:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573888:192.168.204.27@tcp:105: 00000100:00100000:2.0:1789776562.366915:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc26a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776562.370383:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876716449573888:192.168.204.27@tcp:105: 00010000:00010000:3.0:1789776562.370414:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370425:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88592b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370459:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370530:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370543:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370554:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370560:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370566:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370571:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.370575:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370581:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370592:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776562.370595:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776562.370598:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370603:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb8859ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370614:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370626:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370632:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370637:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776562.370640:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370647:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370655:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776562.370658:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789776562.370661:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776562.370666:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb8859e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776562.370951:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:12476:x1876716432760704:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 34783us (34978us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789776562.370962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000020:00080000:3.0:1789776562.370968:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789776562.371381:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776562.371386:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776562.372748:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789776562.372764:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776562.374341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.375056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432761088 00000100:00100000:1.0:1789776562.375066:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432761088 00000100:00100000:1.0:1789776562.375140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1789776562.375151:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:12475:x1876716432761088:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:1.0:1789776562.375299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:12475:x1876716432761088:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 150us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.375307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1789776562.378208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.378312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432761600 00000100:00100000:2.0:1789776562.378335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432761600 00000100:00100000:2.0:1789776562.378396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1789776562.378406:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc90b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+25:12476:x1876716432761600:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789776562.378731:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789776562.378767:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789776562.378817:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378835:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378847:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378856:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378862:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378868:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.378892:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776562.378996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc90b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12476:x1876716432761600:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 591us (800us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789776562.379005:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:2.0:1789776562.379011:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789776562.379369:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776562.379377:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.379384:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776562.379387:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.379396:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.379409:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:0.0:1789776562.379412:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789776562.379417:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.379436:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3600/0xf13b8042cb8859f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776562.379449:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776562.379451:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776562.379453:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776562.381700:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.382008:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432761344 00000100:00100000:2.0:1789776562.382019:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432761344 00000100:00100000:2.0:1789776562.382089:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:2.0:1789776562.382099:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12475:x1876716432761344:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:2.0:1789776562.382453:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789776562.382826:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12475:x1876716432761344:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 725us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.382835:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:3.0:1789776562.453587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776562.453694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432761728 00000100:00100000:2.0:1789776562.453706:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432761728 00000100:00100000:2.0:1789776562.453779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:2.0:1789776562.453790:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+27:12478:x1876716432761728:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776562.453817:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776562.453839:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb8859fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.453916:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.453934:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.453946:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454038:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454047:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454053:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454194:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454225:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 28 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454235:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454413:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 28 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.454429:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 28 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776562.454443:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449574016:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776562.454562:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc64de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776562.461845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776562.461955:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432761984 00000100:00100000:0.0:1789776562.461974:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432761984 00000100:00100000:0.0:1789776562.462036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1789776562.462047:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:6179:x1876716432761984:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789776562.462656:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876716449574016:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776562.462685:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776562.464594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:6179:x1876716432761984:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 2525us (2741us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789776562.464609:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1789776562.476951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776562.480905:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432762112 00000100:00100000:1.0:1789776562.480923:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432762112 00010000:00010000:1.0:1789776562.480976:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 30 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776562.481029:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:1.0:1789776562.481040:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:2411:x1876716432762112:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776562.481058:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776562.481079:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 30 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481093:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 30 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481283:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fe00/0xf13b8042cb88591d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad0 expref: 30 pid: 10345 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481304:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776562.481309:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481331:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481340:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776562.481426:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776562.481541:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:2411:x1876716432762112:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 502us (4599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.481549:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00010000:00010000:2.0:1789776562.481854:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.481864:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776562.481924:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789776562.481929:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776562.481949:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.481978:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.481988:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.481995:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482002:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482009:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.482014:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482023:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482033:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:2.0:1789776562.482035:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.482039:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482045:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3800/0xf13b8042cb885a04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482059:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482065:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482078:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482084:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776562.482086:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482093:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482102:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a5bc1a87400) 00010000:00010000:2.0:1789776562.482276:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776562.482282:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3c00/0xf13b8042cb885a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482338:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3200/0xf13b8042cb8859fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b0f expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482352:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b0f expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776562.482359:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:2.0:1789776562.482361:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776562.482364:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776562.482412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12478:x1876716432761728:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 28624us (28834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776562.482428:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00010000:00010000:2.0:1789776562.594881:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789776563.427683:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776563.427698:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776563.427755:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789776563.427764:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776563.428226:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc456b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449574144:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776563.428369:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca480 going to sleep for 11 seconds 00000040:00080000:1.0:1789776563.432392:0:14756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776563.432404:0:14756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776563.432437:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789776563.432444:0:14756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776563.441632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776563.441676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432762240 00000100:00100000:1.0:1789776563.441687:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432762240 00000100:00100000:1.0:1789776563.441767:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:1.0:1789776563.441778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:12490:x1876716432762240:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776563.441829:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776563.442185:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc456b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876716449574144:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776563.443120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12490:x1876716432762240:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 1336us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.443134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:0.0:1789776563.451991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776563.452135:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432762496 00000100:00100000:3.0:1789776563.452147:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432762496 00000100:00100000:3.0:1789776563.452226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:3.0:1789776563.452240:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+28:12490:x1876716432762496:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776563.452287:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776563.452328:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.452543:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb885a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.453006:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb885a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.453028:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb885a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776563.453048:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789776563.453207:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b16 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.453229:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb885a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b16 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.453238:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776563.453242:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776563.453247:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257a00, rc 0) 00000100:00100000:3.0:1789776563.453394:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:12490:x1876716432762496:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1156us (1419us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789776563.453403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:3.0:1789776563.465981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776563.466121:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432762624 00000100:00100000:1.0:1789776563.466134:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432762624 00000100:00100000:1.0:1789776563.466219:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1789776563.466233:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:2412:x1876716432762624:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776563.466255:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776563.466291:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257a00/0xf13b8042cb885a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b16 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.466331:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776563.466338:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776563.466485:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:2412:x1876716432762624:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 255us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.466528:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1789776563.476159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776563.476248:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432762880 00000100:00100000:2.0:1789776563.476262:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432762880 00000100:00100000:2.0:1789776563.476394:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:2.0:1789776563.476409:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+29:12490:x1876716432762880:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789776563.476577:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476602:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476616:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476820:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476829:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476836:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476843:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776563.476848:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476877:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476906:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:2.0:1789776563.476910:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776563.476916:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.476923:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a2c00/0xf13b8042cb885a2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776563.477083:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:12490:x1876716432762880:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 676us (941us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789776563.477092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 252 00000040:00080000:3.0:1789776563.477275:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776563.477281:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776563.477841:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789776563.477854:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776563.482092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776563.484746:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763136 00000100:00100000:2.0:1789776563.484767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763136 00000100:00100000:2.0:1789776563.484851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1789776563.484864:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+30:12490:x1876716432763136:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776563.485200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:12490:x1876716432763136:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 337us (3119us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789776563.485210:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:3.0:1789776563.620069:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776563.747018:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776563.747052:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776563.747151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776563.747230:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574272 00000100:00100000:3.0:1789776563.747240:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574272 00000100:00100000:3.0:1789776563.747314:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789776563.747326:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449574272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776563.747368:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789776563.747438:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876716449574272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776563.747445:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789776563.747553:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776563.751325:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776563.751360:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449574400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776563.751466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776563.751624:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574400 00000100:00100000:1.0:1789776563.751635:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574400 00000100:00100000:1.0:1789776563.751736:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789776563.751748:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449574400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776563.751779:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789776563.751868:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449574400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.751876:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789776563.752095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776563.752335:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449574400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776564.259080:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449574784:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259274:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449575296:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259334:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449575808:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259375:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:2.0:1789776564.259381:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449574656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259442:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449574528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776564.259468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259486:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449575168:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259626:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449575680:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449576192:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.259758:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574656 00000100:00100000:2.0:1789776564.259767:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574656 00000100:00100000:2.0:1789776564.259840:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789776564.259851:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449574656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.259915:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449574656:12345-0@lo:400:kworker.0 Request processed in 65us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.259922:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789776564.259969:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449574912:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776564.260026:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574784 00000100:00100000:2.0:1789776564.260043:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449575424:0@lo:400:kworker.0 00000100:00100000:1.0:1789776564.260044:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574784 00000100:00100000:2.0:1789776564.260082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.260110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449575936:0@lo:400:kworker.0 00000100:00100000:1.0:1789776564.260128:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575296 00000100:00100000:1.0:1789776564.260135:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575296 00000100:00100000:2.0:1789776564.260142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.260168:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789776564.260171:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575808 00000100:00100000:1.0:1789776564.260177:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575808 00000100:00100000:2.0:1789776564.260179:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449575040:0@lo:400:kworker.0 00000100:00100000:1.0:1789776564.260197:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575424 00000100:00100000:1.0:1789776564.260204:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575424 00000100:00100000:2.0:1789776564.260216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776564.260231:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575936 00000100:00100000:1.0:1789776564.260236:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575936 00000100:00100000:2.0:1789776564.260241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449575552:0@lo:400:kworker.0 00000100:00100000:1.0:1789776564.260253:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575040 00000100:00100000:1.0:1789776564.260258:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575040 00000100:00100000:2.0:1789776564.260279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776564.260298:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789776564.260337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449576064:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776564.260401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789776564.260412:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260450:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449575296:12345-0@lo:400:kworker.0 Request processed in 41us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789776564.260476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789776564.260482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449575808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260546:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449575808:12345-0@lo:400:kworker.0 Request processed in 64us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260552:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789776564.260564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789776564.260570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449575424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449575424:12345-0@lo:400:kworker.0 Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789776564.260636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789776564.260642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449575936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260672:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449575936:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789776564.260689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789776564.260695:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260722:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449575040:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789776564.260749:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575680 00000100:00100000:2.0:1789776564.260755:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575680 00000100:00100000:2.0:1789776564.260785:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576192 00000100:00100000:2.0:1789776564.260788:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576192 00000100:00100000:2.0:1789776564.260801:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575552 00000100:00100000:2.0:1789776564.260803:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575552 00000100:00100000:2.0:1789776564.260814:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576064 00000100:00100000:2.0:1789776564.260817:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576064 00000100:00100000:2.0:1789776564.260831:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789776564.260837:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449575680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260869:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449575680:12345-0@lo:400:kworker.0 Request processed in 33us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260875:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789776564.260887:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789776564.260900:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449576192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260933:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449576192:12345-0@lo:400:kworker.0 Request processed in 34us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260939:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789776564.260954:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789776564.260959:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449575552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.260986:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449575552:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.260993:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789776564.261004:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789776564.261010:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449576064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261036:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449576064:12345-0@lo:400:kworker.0 Request processed in 27us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.261042:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789776564.261085:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449574656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449575680:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261113:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449576192:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261124:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449575296:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449575808:0@lo:400:kworker.0 00000100:00100000:2.0:1789776564.261178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449575040:0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.261186:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776564.261191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449575552:0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.261204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449576320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776564.261206:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449576064:0@lo:400:kworker.0 00010000:00080000:2.0:1789776564.261234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf60e00 x1876716449575424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776564.261245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449575424:0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.261252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789776564.261264:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cedf63100 x1876716449575936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776564.261274:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449575936:0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.261373:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574528 00000100:00100000:3.0:1789776564.261379:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574528 00000100:00100000:3.0:1789776564.261411:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576320 00000100:00100000:3.0:1789776564.261414:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576320 00000100:00100000:3.0:1789776564.261429:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789776564.261436:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449574528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789776564.261463:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776564.261519:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449574528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.261537:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789776564.261552:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789776564.261557:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876716449576320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776564.261567:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776564.261594:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876716449576320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.261600:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789776564.261633:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449576320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776564.261691:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449574528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776564.261783:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449574784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.261876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449575168 00000100:00100000:3.0:1789776564.261882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449575168 00000100:00100000:1.0:1789776564.261910:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449574784:12345-0@lo:400:kworker.0 Request processed in 1597us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.261919:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449574912 00000100:00100000:1.0:1789776564.261922:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789776564.261926:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449574912 00000100:00100000:3.0:1789776564.261954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789776564.261982:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789776564.261996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449574912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776564.262032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449574912:12345-0@lo:400:kworker.0 Request processed in 41us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.262038:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789776564.262112:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449574784:0@lo:400:kworker.0 00000100:00080000:0.0:1789776564.262130:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776564.262139:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776564.262143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776564.262160:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776564.264528:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449574912:0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.265095:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449575168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776564.265237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449575168:12345-0@lo:400:kworker.0 Request processed in 3275us (5632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.265248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789776564.266264:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449575168:0@lo:400:kworker.0 00010000:00010000:1.0:1789776564.645762:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776564.922589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776564.922643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776564.922815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763520 00000100:00100000:2.0:1789776564.922830:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763520 00000100:00100000:2.0:1789776564.922932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 314 00000100:00100000:2.0:1789776564.922944:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432763520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776564.923054:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432763520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 112us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.923063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 314 00000100:00100000:1.0:1789776564.923648:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763264 00000100:00100000:1.0:1789776564.923655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763264 00000100:00100000:1.0:1789776564.923693:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 387 00000100:00100000:1.0:1789776564.923700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432763264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776564.923742:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432763264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.923749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 387 00000100:00080000:3.0:1789776564.924745:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776564.925410:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776564.925524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776564.925621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776564.925647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776564.925673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776564.925704:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764032 00000100:00100000:1.0:1789776564.925715:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764032 00000100:00100000:1.0:1789776564.925777:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763392 00000100:00100000:1.0:1789776564.925780:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763392 00000100:00100000:1.0:1789776564.925804:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763904 00000100:00100000:1.0:1789776564.925806:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763904 00000100:00100000:1.0:1789776564.925825:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:1.0:1789776564.925835:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432764032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776564.925915:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432764032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 82us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.925929:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:1.0:1789776564.925948:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 316 00000100:00100000:1.0:1789776564.925955:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:2411:x1876716432763392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776564.925991:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:2411:x1876716432763392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.926018:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 316 00000100:00100000:2.0:1789776564.926140:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763776 00000100:00100000:2.0:1789776564.926145:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763776 00000100:00100000:2.0:1789776564.926197:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432763648 00000100:00100000:2.0:1789776564.926201:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432763648 00000100:00100000:2.0:1789776564.926231:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1789776564.926239:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432763776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776564.926279:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432763776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.926286:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1789776564.926300:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:2.0:1789776564.926314:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432763648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776564.926342:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2411:x1876716432763648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.926347:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:3.0:1789776564.927399:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:3.0:1789776564.927416:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432763904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776564.927512:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432763904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 102us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.927543:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00080000:3.0:1789776564.927794:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776564.927801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776564.927805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776564.927808:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1789776565.552187:0:14807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776565.552201:0:14807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776565.552268:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789776565.552287:0:14807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789776565.666781:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776565.804776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776565.804887:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764288 00000100:00100000:3.0:1789776565.804899:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764288 00000100:00100000:3.0:1789776565.804987:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:3.0:1789776565.805000:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+31:12511:x1876716432764288:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776565.805029:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776565.805057:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b1d expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.805222:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb885a3c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.805241:0:13443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb885a3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.805268:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb885a3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776565.805283:0:13443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789776565.805417:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b1d expref: 34 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.805443:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb885a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b1d expref: 33 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.805476:0:13443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776565.805480:0:13443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789776565.805484:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257e00, rc 0) 00000100:00100000:3.0:1789776565.805626:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:12511:x1876716432764288:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 628us (866us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789776565.805635:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:3.0:1789776565.818546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776565.818692:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764416 00000100:00100000:1.0:1789776565.818707:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764416 00000100:00100000:1.0:1789776565.818794:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:1.0:1789776565.818808:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:12511:x1876716432764416:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1789776565.818912:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.818937:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.818952:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819213:0:10345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819223:0:10345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819231:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819238:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776565.819244:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819264:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819305:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:1.0:1789776565.819309:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776565.819315:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.819323:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0c00/0xf13b8042cb885a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776565.819429:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+33:12511:x1876716432764416:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 624us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776565.819439:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:2.0:1789776565.940442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776565.940747:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764544 00000100:00100000:0.0:1789776565.940759:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764544 00000100:00100000:0.0:1789776565.940852:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:0.0:1789776565.940866:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2414:x1876716432764544:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1789776565.940891:0:8528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776565.940918:0:8528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd40acfb/0xf13b8042cb885a51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b24 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776565.940952:0:8528:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aadd2b3, atime: 0x6aadd2b2, ctime: 0x6aadd2b3, blocks: 0x8 00010000:00010000:0.0:1789776565.940979:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1789776565.940984:0:8528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776565.940995:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd40acfb/0xf13b8042cb885a51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b24 expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.941019:0:8528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd40acfb/0xf13b8042cb885a51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b24 expref: 8 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.941037:0:8528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdec00, rc 0) 00000100:00100000:0.0:1789776565.941118:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2414:x1876716432764544:12345-192.168.204.27@tcp:101:cat.0 Request processed in 255us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776565.941126:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1789776565.947268:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776565.947415:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764672 00000100:00100000:1.0:1789776565.947638:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764672 00002000:00100000:1.0:1789776565.947713:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8a5bc3edf100 x1876716432764672/t0(0) o3->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:1/0 lens 488/0 e 0 to 0 dl 1789776576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776565.947726:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3edf100 with x1876716432764672 ext(0->4095) 00002000:00010000:1.0:1789776565.947733:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3edf100 00000100:00100000:1.0:1789776565.947776:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1789776565.947787:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432764672:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:1.0:1789776565.948290:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+8:2412:x1876716432764672:12345-192.168.204.27@tcp:3:cat.0 Request processed in 501us (1046us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789776565.948298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00002000:00100000:1.0:1789776565.948306:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8a5bc3edf100 x1876716432764672/t0(0) o3->1c6b552f-1300-40e3-a848-4343cb28ffe2@192.168.204.27@tcp:1/0 lens 488/4536 e 0 to 0 dl 1789776576 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776565.948314:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a5bc3edf100 with x1876716432764672 ext(0->4095) 00002000:00010000:1.0:1789776565.948337:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a5bc3edf100 00010000:00010000:3.0:1789776566.690619:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776567.331607:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776567.331636:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449576448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776567.331701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776567.331756:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576448 00000100:00100000:0.0:1789776567.331762:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576448 00000100:00100000:0.0:1789776567.331803:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789776567.331810:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449576448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776567.331843:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789776567.331883:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449576448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.331890:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789776567.331930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449576448:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789776567.331994:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789776567.339998:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449576576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776567.340088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776567.340174:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576576 00000100:00100000:3.0:1789776567.340182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576576 00000100:00100000:3.0:1789776567.340245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789776567.340256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449576576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776567.340289:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789776567.341814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449576576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1553us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776567.341826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789776567.344467:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449576576:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789776567.587385:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776567.587395:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776567.587414:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789776567.587426:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789776567.714739:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776567.849228:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1789776567.849249:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1789776567.851896:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789776567.851934:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a5cf5c0b9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789776567.851940:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cc814f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a5cf5c0b600 00000020:00080000:3.0:1789776567.851955:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a5cc814f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a5bc4531600 00000020:00080000:3.0:1789776567.851976:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1789776567.852040:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852053:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852062:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852068:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776567.852074:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852081:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852102:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a5cc3eded00) 00010000:00010000:2.0:1789776567.852105:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776567.852112:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.852127:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb8859cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13443 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789776567.852412:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789776567.852482:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1789776567.854031:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1789776568.743851:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776568.873916:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776568.873940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449576704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776568.874019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776568.874904:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576704 00000100:00100000:3.0:1789776568.874915:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576704 00000100:00100000:3.0:1789776568.874968:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789776568.874979:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449576704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776568.875007:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789776568.875702:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776568.875719:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449576832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776568.877348:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449576704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2360us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776568.877363:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789776568.877405:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776568.887709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776568.887774:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576832 00000100:00100000:1.0:1789776568.887782:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576832 00000100:00100000:1.0:1789776568.887844:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789776568.887855:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cef17bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449576832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776568.887881:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789776568.887925:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cef17bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449576832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776568.887932:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789776568.889296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776568.889364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449576704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776568.889400:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:1.0:1789776568.889406:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5bc3eded80, transno 4294967324 00000004:00080000:1.0:1789776568.889420:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:1.0:1789776568.889445:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449576832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776569.381403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449576960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776569.381514:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776569.382134:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449577088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776569.382163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776569.382284:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449576960 00000100:00100000:0.0:1789776569.382292:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449576960 00000100:00100000:0.0:1789776569.382346:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577088 00000100:00100000:0.0:1789776569.382348:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577088 00000100:00100000:0.0:1789776569.382363:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789776569.382371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449576960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776569.382396:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776569.382442:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449576960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.382448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789776569.382464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789776569.382471:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449577088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776569.382481:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776569.382546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449577088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.382552:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789776569.382586:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789776569.382592:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789776569.382612:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5bc4569180, transno 4294967311 00000100:00100000:0.0:1789776569.382634:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449576960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776569.382655:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449577472:0@lo:400:kworker.0 00000100:00100000:0.0:1789776569.382686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776569.382821:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577472 00000100:00100000:0.0:1789776569.382825:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577472 00000100:00100000:0.0:1789776569.382850:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789776569.382857:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449577472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776569.382895:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449577472:12345-0@lo:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.382901:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789776569.382923:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449577472:0@lo:400:kworker.0 00000100:00080000:1.0:1789776569.382992:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776569.383005:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449577216:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.383040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.383074:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776569.383080:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449577344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.383106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.383138:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577344 00000100:00100000:1.0:1789776569.383141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577344 00000100:00100000:1.0:1789776569.383167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789776569.383174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.383220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449577344:12345-0@lo:400:kworker.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776569.383225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789776569.383248:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449577344:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.383684:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449577088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776569.383760:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577216 00000100:00100000:0.0:1789776569.383766:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577216 00000100:00100000:0.0:1789776569.383802:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789776569.383809:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449577216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776569.383857:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449577216:12345-0@lo:400:kworker.0 Request processed in 48us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.383863:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789776569.383948:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449577216:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.385560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449577728:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.385621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.385664:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449578240:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.385691:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449577600:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.385694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.385719:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776569.385728:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449577856:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.385736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.385765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577728 00000100:00100000:1.0:1789776569.385772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577728 00000100:00100000:2.0:1789776569.385783:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449578112:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.385811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789776569.385815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.385824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc7de3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449577728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.385839:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776569.385849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449577984:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.385878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776569.385900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc7de3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449577728:12345-0@lo:400:kworker.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776569.385908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789776569.385919:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578240 00000100:00100000:2.0:1789776569.385924:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578240 00000100:00100000:2.0:1789776569.385963:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577600 00000100:00100000:2.0:1789776569.385966:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577600 00000100:00100000:2.0:1789776569.385980:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578112 00000100:00100000:2.0:1789776569.385983:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578112 00000100:00100000:2.0:1789776569.386000:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577984 00000100:00100000:2.0:1789776569.386003:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577984 00000100:00100000:2.0:1789776569.386022:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789776569.386030:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449578240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.386071:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449578240:12345-0@lo:400:kworker.0 Request processed in 42us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.386086:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789776569.386107:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789776569.386115:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449577600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.386156:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449577600:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.386164:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789776569.386182:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789776569.386207:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449578112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.386246:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449578112:12345-0@lo:400:kworker.0 Request processed in 41us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.386252:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789776569.386273:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789776569.386282:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449577984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.386313:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449577984:12345-0@lo:400:kworker.0 Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.386319:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1789776569.386352:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776569.386356:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789776569.386370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789776569.386970:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff491f80 x1876716449577984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776569.386984:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449577984:0@lo:400:kworker.0 00000100:00100000:3.0:1789776569.386998:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449577600:0@lo:400:kworker.0 00000100:00100000:3.0:1789776569.387008:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449578112:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.389930:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449577856 00000100:00100000:2.0:1789776569.389945:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449577856 00010000:00080000:1.0:1789776569.389961:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff491500 x1876716449578240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776569.389980:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449578240:0@lo:400:kworker.0 00000100:00100000:1.0:1789776569.390000:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449577728:0@lo:400:kworker.0 00000100:00100000:2.0:1789776569.390019:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789776569.390031:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449577856:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789776569.390055:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776569.390130:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449577856:12345-0@lo:400:kworker.0 Request processed in 102us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.390137:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789776569.390230:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449577856:0@lo:400:kworker.0 00010000:00010000:3.0:1789776569.762676:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776570.042768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.042971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776570.043003:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765312 00000100:00100000:3.0:1789776570.043028:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765312 00000100:00100000:3.0:1789776570.043101:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765184 00000100:00100000:3.0:1789776570.043105:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765184 00000100:00100000:3.0:1789776570.043128:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:3.0:1789776570.043138:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432765312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776570.043230:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432765312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.043406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764800 00000100:00100000:2.0:1789776570.043421:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764800 00000100:00100000:2.0:1789776570.043461:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 389 00000100:00100000:2.0:1789776570.043469:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432764800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776570.043520:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2413:x1876716432764800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 52us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.043528:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 389 00000100:00100000:3.0:1789776570.043760:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:3.0:1789776570.043778:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1789776570.043786:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2413:x1876716432765184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776570.043817:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2413:x1876716432765184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776570.043823:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1789776570.043841:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765056 00000100:00100000:3.0:1789776570.043845:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765056 00000100:00100000:3.0:1789776570.043870:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765568 00000100:00100000:3.0:1789776570.043872:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765568 00000100:00100000:3.0:1789776570.043883:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432764928 00000100:00100000:3.0:1789776570.043885:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432764928 00000100:00100000:3.0:1789776570.043893:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765440 00000100:00100000:3.0:1789776570.043895:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765440 00000100:00100000:3.0:1789776570.043907:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:3.0:1789776570.043913:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432765056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776570.043940:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2413:x1876716432765056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776570.043946:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 324 00000100:00100000:3.0:1789776570.043957:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:3.0:1789776570.043971:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432765568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776570.043997:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432765568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776570.044002:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 325 00000100:00100000:3.0:1789776570.044014:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 326 00000100:00100000:3.0:1789776570.044020:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:2413:x1876716432764928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776570.044151:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:1.0:1789776570.044162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432765440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776570.044200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2413:x1876716432765440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.044206:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00080000:1.0:1789776570.044228:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776570.044231:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776570.044246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776570.044249:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776570.044519:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:2413:x1876716432764928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 474us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776570.044526:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 326 00010000:00010000:1.0:1789776570.787040:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776570.800281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776570.800657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765696 00000100:00100000:1.0:1789776570.800667:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765696 00000100:00100000:1.0:1789776570.800747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1789776570.800757:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:12156:x1876716432765696:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789776570.800882:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:12156:x1876716432765696:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 126us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.800890:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:3.0:1789776570.805736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776570.805891:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432765824 00000100:00100000:2.0:1789776570.805903:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432765824 00000100:00100000:2.0:1789776570.805970:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:2.0:1789776570.805980:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:12156:x1876716432765824:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789776570.806483:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:12156:x1876716432765824:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 503us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.806549:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:3.0:1789776570.812191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776570.812443:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766080 00000100:00100000:2.0:1789776570.812454:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766080 00000100:00100000:2.0:1789776570.812559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1789776570.812571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:12156:x1876716432766080:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776570.812804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:12156:x1876716432766080:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 235us (621us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789776570.812813:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1789776571.046473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776571.046605:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766208 00000100:00100000:3.0:1789776571.046615:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766208 00000100:00100000:3.0:1789776571.046784:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:3.0:1789776571.046795:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:12969:x1876716432766208:12345-192.168.204.27@tcp:101:lsof.0 00010000:00010000:3.0:1789776571.046816:0:10345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776571.046835:0:10345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b2b expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.046898:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.046924:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.046935:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776571.047005:0:10345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776571.047009:0:10345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776571.047029:0:10345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.047052:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257400/0xf13b8042cb885a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b2b expref: 7 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.047072:0:10345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b2b expref: 6 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.047080:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:3.0:1789776571.047084:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776571.047088:0:10345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256a00, rc 0) 00000100:00100000:3.0:1789776571.047175:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:12969:x1876716432766208:12345-192.168.204.27@tcp:101:lsof.0 Request processed in 381us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.047182:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 257 00010000:00010000:0.0:1789776571.810797:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776572.450921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776572.450945:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449578368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776572.452446:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449578496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776572.463915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776572.466030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578368 00000100:00100000:1.0:1789776572.466047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578368 00000100:00100000:1.0:1789776572.466150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789776572.466162:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449578368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776572.466203:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789776572.466306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449578368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776572.466313:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789776572.466420:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449578368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776572.466812:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776572.466948:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578496 00000100:00100000:0.0:1789776572.466954:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578496 00000100:00100000:0.0:1789776572.466995:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789776572.467003:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449578496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776572.467024:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776572.467087:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449578496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776572.467094:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789776572.467942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449578496:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789776572.834793:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789776573.478704:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789776573.478719:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789776573.478786:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789776573.478797:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789776573.860036:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776573.987287:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449578624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776573.987380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776573.988552:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776573.988566:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449578752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776573.988607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776573.988646:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578624 00000100:00100000:3.0:1789776573.988652:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578624 00000100:00100000:3.0:1789776573.988703:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578752 00000100:00100000:3.0:1789776573.988706:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578752 00000100:00100000:3.0:1789776573.988720:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789776573.988728:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449578624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776573.988754:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789776573.988811:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cedf60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449578624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776573.988818:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789776573.988835:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789776573.988841:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449578752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776573.988850:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789776573.988877:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449578752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776573.988882:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789776573.988897:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776573.988935:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449578752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776573.988971:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449578624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776574.499049:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449579264:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.499184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449578880:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.512861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776574.513001:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449579392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776574.513066:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579392 00000100:00100000:3.0:1789776574.513073:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579392 00000100:00100000:3.0:1789776574.513130:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789776574.513138:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513195:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449579392:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776574.513202:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789776574.513243:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449579392:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513312:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449579904:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776574.513366:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579904 00000100:00100000:3.0:1789776574.513370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579904 00000100:00100000:3.0:1789776574.513404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789776574.513411:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449579904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449579904:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776574.513446:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:3.0:1789776574.513461:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789776574.513481:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3ede680 x1876716449579904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776574.513514:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449579904:0@lo:400:kworker.0 00000100:00100000:3.0:1789776574.513536:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776574.513563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776574.513585:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580416 00000100:00100000:3.0:1789776574.513588:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580416 00000100:00100000:3.0:1789776574.513615:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789776574.513621:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449580416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776574.513642:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776574.513671:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449580416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776574.513683:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1789776574.513698:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776574.513722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776574.513735:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776574.513740:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449580288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776574.513764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776574.513784:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580288 00000100:00100000:3.0:1789776574.513787:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580288 00000100:00100000:3.0:1789776574.513812:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789776574.513818:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449580288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789776574.513828:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789776574.513854:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449580288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776574.513860:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789776574.514074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514132:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449579008:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514179:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449579520:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449580032:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514343:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789776574.514350:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449579136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449579648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449580160:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776574.514472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579264 00000100:00100000:1.0:1789776574.514475:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579264 00000100:00100000:1.0:1789776574.514529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579008 00000100:00100000:1.0:1789776574.514532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579008 00000100:00100000:1.0:1789776574.514544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579520 00000100:00100000:1.0:1789776574.514546:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579520 00000100:00100000:1.0:1789776574.514557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579648 00000100:00100000:1.0:1789776574.514559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579648 00000100:00100000:1.0:1789776574.514572:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789776574.514577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449579264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449579264:12345-0@lo:400:kworker.0 Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.514617:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789776574.514630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789776574.514635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449579008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514664:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449579008:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.514669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789776574.514681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789776574.514686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449579520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514723:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449579520:12345-0@lo:400:kworker.0 Request processed in 36us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.514729:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789776574.514740:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789776574.514747:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514769:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449579648:12345-0@lo:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.514774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789776574.514790:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580032 00000100:00100000:1.0:1789776574.514793:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580032 00000100:00100000:1.0:1789776574.514813:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580160 00000100:00100000:1.0:1789776574.514816:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580160 00000100:00100000:1.0:1789776574.514830:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789776574.514836:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449580032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.514862:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449580032:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.514866:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789776574.515035:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449578880 00000100:00100000:2.0:1789776574.515039:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449578880 00000100:00100000:2.0:1789776574.515075:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789776574.515081:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449578880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776574.515128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3644:x1876716449578880:12345-0@lo:400:kworker.0 Request processed in 47us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.515134:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789776574.515165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579136 00000100:00100000:2.0:1789776574.515169:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579136 00000100:00100000:2.0:1789776574.515189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789776574.515194:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449579136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776574.515224:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449579136:12345-0@lo:400:kworker.0 Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.515231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789776574.519713:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789776574.519735:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449580160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776574.519831:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449580160:12345-0@lo:400:kworker.0 Request processed in 107us (5387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.519839:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789776574.524016:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776574.524029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776574.524033:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776574.524130:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449580288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776574.524144:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3644:1876716449578880:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449579136:0@lo:400:kworker.0 00010000:00080000:1.0:1789776574.526263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3edc000 x1876716449579648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776574.526274:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449579648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526287:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449580160:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449579008:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526307:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449579520:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526327:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449580032:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526383:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449579264:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526392:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449579776:0@lo:400:kworker.0 00000100:00100000:1.0:1789776574.526446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776574.534622:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449579776 00000100:00100000:2.0:1789776574.534636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449579776 00000100:00080000:1.0:1789776574.534707:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776574.534711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789776574.534721:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449579776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776574.534831:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449579776:12345-0@lo:400:kworker.0 Request processed in 112us (8383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.534839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789776574.535029:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449579776:0@lo:400:kworker.0 00000001:02000400:0.0:1789776574.653173:0:15005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:09:34 (1789776574) 00010000:00010000:1.0:1789776574.885027:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776575.171789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776575.171837:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776575.171856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766464 00000100:00100000:0.0:1789776575.171865:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776575.171866:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766464 00000100:00100000:0.0:1789776575.171904:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776575.171933:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766592 00000100:00100000:3.0:1789776575.171938:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766592 00000100:00100000:0.0:1789776575.171948:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776575.171974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432767104 00000100:00100000:3.0:1789776575.171979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432767104 00000100:00100000:3.0:1789776575.172002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:1.0:1789776575.172011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 335 00000100:00100000:3.0:1789776575.172016:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:2412:x1876716432766464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776575.172026:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432766592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776575.172113:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766336 00000100:00100000:2.0:1789776575.172117:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766336 00000100:00100000:2.0:1789776575.172144:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 391 00000100:00100000:2.0:1789776575.172150:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432766336:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776575.172962:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:2412:x1876716432766464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 946us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776575.172962:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432766592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 935us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776575.173395:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 334 00000100:00100000:2.0:1789776575.175066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2411:x1876716432766336:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 2908us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776575.175089:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 391 00000100:00100000:0.0:1789776575.175863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776575.176157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776575.176249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766848 00000100:00100000:0.0:1789776575.176257:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766848 00000100:00100000:0.0:1789776575.176303:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766720 00000100:00100000:0.0:1789776575.176305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766720 00000100:00100000:0.0:1789776575.176325:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:0.0:1789776575.176334:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432766848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776575.177084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 335 00000100:00100000:3.0:1789776575.177128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:2.0:1789776575.177182:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432766976 00000100:00100000:2.0:1789776575.177188:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432766976 00000100:00100000:2.0:1789776575.177216:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:2.0:1789776575.177223:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432766976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776575.177348:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432767104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776575.177389:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1789776575.177400:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432766720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776575.177477:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2411:x1876716432766848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1142us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776575.177508:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:2.0:1789776575.177531:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432766976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 305us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776575.177540:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00080000:2.0:1789776575.177565:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789776575.177570:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776575.177573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776575.177576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776575.177798:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2411:x1876716432767104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 453us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776575.177808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:1.0:1789776575.178462:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2412:x1876716432766720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1062us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776575.178471:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00010000:00010000:1.0:1789776575.908211:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776576.933140:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776577.570812:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc456a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449580544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776577.570915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776577.571310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580544 00000100:00100000:0.0:1789776577.571321:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580544 00000100:00100000:0.0:1789776577.571386:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776577.571399:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449580544:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776577.571432:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449580672:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776577.571445:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789776577.571469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776577.571516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449580544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776577.571525:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776577.571541:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580672 00000100:00100000:0.0:1789776577.571545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580672 00000100:00100000:0.0:1789776577.571564:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789776577.571571:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449580672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776577.571589:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789776577.571623:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449580672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776577.571629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000040:00080000:1.0:1789776577.571974:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789776577.572094:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc456a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449580544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776577.572166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449580672:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789776577.827073:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776577.827082:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776577.827191:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789776577.827200:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789776577.956539:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776578.979579:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776579.109719:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776579.109751:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449580800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776579.109854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776579.110069:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580800 00000100:00100000:1.0:1789776579.110080:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580800 00000100:00080000:0.0:1789776579.110153:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776579.110181:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789776579.110194:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449580800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776579.110234:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789776579.110308:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776579.110321:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449580928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776579.113917:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449580800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3696us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776579.113936:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776579.114214:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776579.114353:0:9975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449580928 00000100:00100000:0.0:1789776579.114364:0:9975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449580928 00000100:00100000:0.0:1789776579.114443:0:9975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789776579.114454:0:9975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449580928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776579.114484:0:9975:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789776579.114560:0:9975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449580928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.114567:0:9975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1789776579.114689:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776579.114736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449580928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776579.117160:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449580800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776579.471614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776579.472260:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432767360 00000100:00100000:3.0:1789776579.472274:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432767360 00000100:00100000:3.0:1789776579.472409:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:3.0:1789776579.472423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+19:13192:x1876716432767360:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:3.0:1789776579.472817:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:13192:x1876716432767360:12345-192.168.204.27@tcp:35:umount.0 Request processed in 396us (1217us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789776579.472825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00080000:2.0:1789776579.473283:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776579.477250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776579.477558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432767616 00000100:00100000:3.0:1789776579.477572:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432767616 00000100:00100000:3.0:1789776579.477657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776579.477671:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+20:13192:x1876716432767616:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:3.0:1789776579.478333:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:13192:x1876716432767616:12345-192.168.204.27@tcp:35:umount.0 Request processed in 662us (1094us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789776579.478366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1789776579.487368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776579.487538:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432767872 00000100:00100000:0.0:1789776579.487551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432767872 00000100:00100000:0.0:1789776579.487679:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1789776579.487692:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc90b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+21:13192:x1876716432767872:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:0.0:1789776579.488040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc90b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:13192:x1876716432767872:12345-192.168.204.27@tcp:35:umount.0 Request processed in 349us (685us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789776579.488049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1789776579.495127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776579.495352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432768128 00000100:00100000:3.0:1789776579.495367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432768128 00000100:00100000:3.0:1789776579.495450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776579.495462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+22:13192:x1876716432768128:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:3.0:1789776579.495898:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:13192:x1876716432768128:12345-192.168.204.27@tcp:35:umount.0 Request processed in 437us (879us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789776579.495908:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1789776579.500617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776579.500665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776579.500763:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432768256 00000100:00100000:0.0:1789776579.500777:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432768256 00000100:00100000:0.0:1789776579.500856:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432768384 00000100:00100000:0.0:1789776579.500859:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432768384 00000100:00100000:0.0:1789776579.500903:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1789776579.500915:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+14:2414:x1876716432768256:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776579.500936:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776579.500962:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342c800/0xf13b8042cb884a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab567e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776579.500983:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776579.501068:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+13:2414:x1876716432768256:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 154us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.501075:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1789776579.501096:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776579.501102:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+12:2414:x1876716432768384:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776579.501110:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776579.501120:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342d000/0xf13b8042cb884979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab563f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776579.501151:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776579.501187:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:2414:x1876716432768384:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 84us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.501194:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1789776579.503815:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776579.503859:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776579.503946:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432768512 00000100:00100000:0.0:1789776579.503959:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432768512 00000100:00100000:0.0:1789776579.504054:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1789776579.504068:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:2414:x1876716432768512:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776579.504098:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776579.504124:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342c600/0xf13b8042cb884c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5757 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776579.504144:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776579.504301:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2414:x1876716432768512:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 236us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.504310:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776579.505221:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432768640 00000100:00100000:2.0:1789776579.505233:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432768640 00000100:00100000:2.0:1789776579.505310:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:2.0:1789776579.505321:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432768640:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:2.0:1789776579.505356:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884d54 00000100:00080000:2.0:1789776579.505367:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5cd884f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776579.505430:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789776579.505645:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c6b552f-1300-40e3-a848-4343cb28ffe2+2:2410:x1876716432768640:12345-192.168.204.27@tcp:9:umount.0 Request processed in 326us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.505653:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00010000:00010000:1.0:1789776579.505831:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776579.505899:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776579.515263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776579.515547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432769024 00000100:00100000:2.0:1789776579.515561:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432769024 00000100:00100000:2.0:1789776579.515664:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:2.0:1789776579.515676:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2410:x1876716432769024:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:2.0:1789776579.515718:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884fc3 00000020:00010000:2.0:1789776579.515727:0:8433:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a5cd884e800: total 0 00000100:00080000:2.0:1789776579.515733:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8a5cd884c000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789776579.515771:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1789776579.515944:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:1.0:1789776579.515965:0:7925:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a5cd884e800: total 0 00010000:00010000:1.0:1789776579.516100:0:7925:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a5cd884e800, canceled 0 locks, left on hash table 2. 00000100:00100000:2.0:1789776579.516700:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432769024:12345-192.168.204.27@tcp:9:umount.0 Request processed in 1021us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.516710:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00010000:00010000:1.0:1789776579.517650:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd40acfb/0xf13b8042cb885a51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b24 expref: 4 pid: 8528 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776579.517723:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885382 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5941 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776579.517751:0:7925:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a5cd884e800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789776579.517789:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776579.517792:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776579.517794:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776579.526452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776579.526744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770048 00000100:00100000:0.0:1789776579.526767:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770048 00000100:00100000:0.0:1789776579.526839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:0.0:1789776579.526851:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+23:2410:x1876716432770048:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1789776579.526894:0:6517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884987 00000020:00010000:0.0:1789776579.526914:0:6517:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a5bc31ad000: total 0 00000100:00080000:0.0:1789776579.526919:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8a5bc31a8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776579.526957:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1789776579.527103:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a5bc31ad000: total 0 00010000:00010000:3.0:1789776579.527191:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a5bc31ad000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1789776579.527234:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:3.0:1789776579.527238:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776579.527247:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3e00/0xf13b8042cb8853eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab595d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527268:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5cf512d900) 00010000:00010000:3.0:1789776579.527271:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776579.527274:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8c00/0xf13b8042cb884ccf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab576c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527294:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776579.527297:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776579.527301:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0800/0xf13b8042cb885335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab592c expref: 20 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527313:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776579.527333:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789776579.527337:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1600/0xf13b8042cb88536d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab593a expref: 19 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527353:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776579.527355:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776579.527359:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8000/0xf13b8042cb885025 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab585a expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527371:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776579.527374:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776579.527377:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342c400/0xf13b8042cb885932 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ad7 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527390:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776579.527392:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776579.527395:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9600/0xf13b8042cb885407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5964 expref: 16 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527406:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776579.527409:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776579.527412:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc31a3000/0xf13b8042cb885a12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b0f expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527423:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776579.527425:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776579.527428:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f9a00/0xf13b8042cb885263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab58f4 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527451:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a5cf512db00) 00010000:00010000:3.0:1789776579.527453:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776579.527457:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8400/0xf13b8042cb88535f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5933 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527471:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5cf512d500) 00010000:00010000:3.0:1789776579.527473:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776579.527476:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc25f8800/0xf13b8042cb884cb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5765 expref: 12 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527489:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a5cf512c300) 00010000:00010000:3.0:1789776579.527535:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789776579.527539:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257e00/0xf13b8042cb885a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b1d expref: 11 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527560:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a5bc1a87c00) 00010000:00010000:3.0:1789776579.527563:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776579.527566:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb884d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5781 expref: 10 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527581:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a5cf512cb00) 00010000:00010000:3.0:1789776579.527583:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776579.527586:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0e00/0xf13b8042cb8856f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5a3d expref: 9 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776579.527599:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a5bc31ad000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1789776579.527615:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776579.527622:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776579.527624:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776579.528123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c6b552f-1300-40e3-a848-4343cb28ffe2+7:2410:x1876716432770048:12345-192.168.204.27@tcp:39:umount.0 Request processed in 1271us (1683us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789776579.528454:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:3.0:1789776579.539551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776579.540272:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770176 00000100:00100000:2.0:1789776579.540286:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770176 00000100:00100000:2.0:1789776579.540432:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 259 00000100:00100000:2.0:1789776579.540446:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+5:2410:x1876716432770176:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:2.0:1789776579.540520:0:13443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88498e 00000100:00080000:2.0:1789776579.540542:0:13443:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc241000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776579.540580:0:13443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789776579.540804:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c6b552f-1300-40e3-a848-4343cb28ffe2+3:2410:x1876716432770176:12345-192.168.204.27@tcp:39:umount.0 Request processed in 359us (1315us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789776579.540812:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 259 00010000:00010000:1.0:1789776579.540885:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776579.540958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776579.620116:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449581056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776579.620232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776579.620350:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776579.620362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc4569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449581184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776579.620400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776579.620563:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581056 00000100:00100000:0.0:1789776579.620582:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581056 00000100:00100000:0.0:1789776579.620652:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581184 00000100:00100000:0.0:1789776579.620656:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581184 00000100:00100000:0.0:1789776579.620677:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789776579.620688:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449581056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776579.620735:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776579.620803:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449581056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.620814:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789776579.620839:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789776579.620846:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449581184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776579.620857:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789776579.620881:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449581184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.620887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789776579.620945:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc4569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449581184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776579.620960:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449581056:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789776579.621311:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776579.622311:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449581312:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776579.622449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449581824:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776579.622543:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449582336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776579.622593:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789776579.622598:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449581440:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776579.622651:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449581952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776579.622727:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581824 00000100:00100000:2.0:1789776579.622734:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581824 00000100:00100000:2.0:1789776579.622779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789776579.622788:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449581824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.622908:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449581824:12345-0@lo:400:kworker.0 Request processed in 120us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.622916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789776579.622943:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582336 00000100:00100000:2.0:1789776579.622948:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582336 00000100:00100000:2.0:1789776579.622983:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581440 00000100:00100000:2.0:1789776579.622998:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581440 00000100:00100000:2.0:1789776579.623018:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581952 00000100:00100000:2.0:1789776579.623021:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581952 00000100:00100000:2.0:1789776579.623038:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789776579.623044:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449582336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.623075:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449582336:12345-0@lo:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.623081:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789776579.623093:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789776579.623099:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449581440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.623123:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449581440:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.623149:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789776579.623162:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789776579.623168:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449581952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.623195:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449581952:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776579.623221:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:2.0:1789776579.623246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776579.623251:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776579.623279:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449581440:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.623353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449581952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776579.623375:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449581824:0@lo:400:kworker.0 00010000:00080000:2.0:1789776579.623388:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3d4c380 x1876716449582336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776579.623398:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449582336:0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449581696:0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776579.623709:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776579.623764:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789776579.623771:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449581568:0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776579.623816:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449582080:0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776579.623862:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581568 00000100:00100000:1.0:1789776579.623866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581568 00000100:00100000:1.0:1789776579.623908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789776579.623915:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449581568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776579.623952:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449581568:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776579.623958:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789776579.624001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449581568:0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624069:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581696 00000100:00100000:0.0:1789776579.624074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581696 00000100:00100000:0.0:1789776579.624106:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582208 00000100:00100000:0.0:1789776579.624110:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582208 00000100:00100000:0.0:1789776579.624143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582080 00000100:00100000:0.0:1789776579.624146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582080 00000100:00100000:0.0:1789776579.624163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789776579.624178:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449581696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624221:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449581696:12345-0@lo:400:kworker.0 Request processed in 44us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.624227:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789776579.624242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789776579.624248:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449582208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876716449582208:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.624282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789776579.624294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789776579.624299:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449582080:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.624332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:0.0:1789776579.624348:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776579.624351:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776579.624369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3d4e680 x1876716449582080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776579.624378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449582080:0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449581696:0@lo:400:kworker.0 00000100:00100000:0.0:1789776579.624410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876716449582208:0@lo:400:kworker.0 00000100:00100000:3.0:1789776579.626298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449581312 00000100:00100000:3.0:1789776579.626316:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449581312 00000100:00100000:3.0:1789776579.626405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789776579.626416:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449581312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776579.626579:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449581312:12345-0@lo:400:kworker.0 Request processed in 165us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776579.626588:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789776579.628403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cedf61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449581312:0@lo:400:kworker.0 00010000:00010000:1.0:1789776580.006593:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776580.282414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776580.283105:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776580.283145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776580.283221:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770560 00000100:00100000:1.0:1789776580.283231:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770560 00000100:00100000:1.0:1789776580.283301:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770432 00000100:00100000:1.0:1789776580.283304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770432 00000100:00100000:1.0:1789776580.283330:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:1.0:1789776580.283340:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432770560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776580.283412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2412:x1876716432770560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776580.283420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:1.0:1789776580.283451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:1.0:1789776580.283457:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432770432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776580.283485:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2412:x1876716432770432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776580.283516:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00080000:3.0:1789776580.285103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776580.285113:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776580.288364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770304 00000100:00100000:2.0:1789776580.288379:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770304 00000100:00100000:2.0:1789776580.288527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 393 00000100:00100000:2.0:1789776580.288539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432770304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776580.288640:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2412:x1876716432770304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 104us (6235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776580.288649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 393 00010000:00010000:3.0:1789776581.027859:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776581.351639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776581.352108:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776581.356828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776581.357621:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770688 00000100:00100000:2.0:1789776581.357633:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770688 00000100:00100000:2.0:1789776581.357704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770944 00000100:00100000:2.0:1789776581.357707:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770944 00000100:00100000:2.0:1789776581.357742:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776581.357753:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+11:2411:x1876716432770688:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776581.357803:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776581.357827:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f8600/0xf13b8042cb884a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5693 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776581.357857:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776581.357931:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+10:2411:x1876716432770688:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 180us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776581.357939:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776581.357975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776581.357992:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+9:2411:x1876716432770944:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776581.358823:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776581.358841:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb884c82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5750 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776581.358855:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776581.358900:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:2411:x1876716432770944:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 908us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776581.358919:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1789776581.365060:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432770816 00000100:00100000:0.0:1789776581.365075:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432770816 00000100:00100000:0.0:1789776581.365151:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1789776581.365161:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+8:2411:x1876716432770816:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776581.365197:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776581.365221:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb884a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab56c4 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776581.365240:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776581.365316:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+7:2411:x1876716432770816:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 156us (8497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776581.365324:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1789776581.367343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776581.367619:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771200 00000100:00100000:2.0:1789776581.367633:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771200 00000100:00100000:2.0:1789776581.367709:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:2.0:1789776581.367723:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+6:2410:x1876716432771200:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:2.0:1789776581.367782:0:13443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884a9f 00000020:00010000:2.0:1789776581.367795:0:13443:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a5bc24d4000: total 0 00000100:00080000:2.0:1789776581.367800:0:13443:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776581.368098:0:13443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789776581.368337:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2410:x1876716432771200:12345-192.168.204.27@tcp:39:umount.0 Request processed in 615us (1005us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789776581.368365:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 260 00000020:00010000:1.0:1789776581.373814:0:6504:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a5bc24d4000: total 0 00010000:00010000:1.0:1789776581.375090:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776581.375167:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a5bc24d4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789776581.375210:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5bc2122a00) 00010000:00010000:1.0:1789776581.375215:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776581.375226:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb885a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b2b expref: 4 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776581.376282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776581.376726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771328 00000100:00100000:0.0:1789776581.376739:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771328 00000100:00100000:0.0:1789776581.376813:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 261 00000100:00100000:0.0:1789776581.376827:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+5:2410:x1876716432771328:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1789776581.376881:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884aa6 00000100:00080000:0.0:1789776581.376893:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a5bc24d6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776581.376924:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789776581.376949:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776581.377113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da875f9e-f31d-49b9-bb9b-3e43b9776cb6+3:2410:x1876716432771328:12345-192.168.204.27@tcp:39:umount.0 Request processed in 289us (841us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789776581.377122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 261 00010000:00010000:1.0:1789776581.379668:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a5bc24d4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789776581.379710:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776581.379713:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776581.379716:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776581.426830:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776581.427001:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771584 00000100:00100000:0.0:1789776581.427016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771584 00000100:00100000:0.0:1789776581.427110:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 394 00000100:00100000:0.0:1789776581.427235:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+7:2410:x1876716432771584:12345-192.168.204.27@tcp:251:umount.0 00000020:00000080:0.0:1789776581.427299:0:6509:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884964 00000020:00010000:0.0:1789776581.427310:0:6509:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a5cd93f0000: total 0 00000100:00080000:0.0:1789776581.427315:0:6509:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f2800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789776581.427418:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd9b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26d07c66-77a6-40e8-834e-e7f05c9f1ea4+3:2410:x1876716432771584:12345-192.168.204.27@tcp:251:umount.0 Request processed in 297us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776581.427446:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 394 00000020:00010000:3.0:1789776581.427652:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a5cd93f0000: total 0 00010000:00010000:3.0:1789776581.427730:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a5cd93f0000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789776581.427776:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342c200/0xf13b8042cb884a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5685 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776581.427848:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a5cd93f0000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789776581.427869:0:6505:0:(genops.c:885:class_export_put()) final put ffff8a5cd93f0000/26d07c66-77a6-40e8-834e-e7f05c9f1ea4 00010000:00010000:2.0:1789776581.427932:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776581.427935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776581.427937:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789776581.427973:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd93f0000/26d07c66-77a6-40e8-834e-e7f05c9f1ea4 for MGS 00000020:00000080:3.0:1789776581.428292:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd93f2800 for MGS 00010000:00010000:3.0:1789776582.050619:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776582.695229:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776582.695263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449582464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776582.695363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449582592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776582.695439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.695602:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582464 00000100:00100000:2.0:1789776582.695612:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582464 00000100:00100000:2.0:1789776582.695672:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789776582.695691:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449582464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776582.695737:0:7805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789776582.695807:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449582464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.695817:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789776582.695880:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449582464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776582.696001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776582.697235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582592 00000100:00100000:1.0:1789776582.697249:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582592 00000100:00100000:1.0:1789776582.698067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789776582.698077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449582592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776582.698115:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789776582.698193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449582592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776582.698201:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789776582.699403:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449582592:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1789776583.006228:0:15201:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789776583.027813:0:15201:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789776583.028569:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.028586:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.028594:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.028601:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.028619:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789776583.028624:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789776583.028655:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776583.028660:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789776583.028667:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789776583.028669:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776583.028679:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.028689:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf1800 already unused, calling callback (ffffffffc11fbc20) 00000100:00080000:3.0:1789776583.028691:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cedd4e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:0.0:1789776583.028695:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.028707:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776583.028716:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776583.028722:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776583.028724:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789776583.028727:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789776583.028754:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.028761:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776583.028794:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.028801:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1800/0xf13b8042cb884a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.028815:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776583.028827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776583.028829:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776583.028854:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776583.028873:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc456a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449582848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776583.028953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776583.029548:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449582720:0@lo:39:umount.0 00000100:00100000:2.0:1789776583.029644:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582848 00000100:00100000:2.0:1789776583.029655:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582848 00000100:00100000:3.0:1789776583.029670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776583.029716:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776583.029726:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3645:x1876716449582848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776583.029742:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789776583.029759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582720 00010000:00010000:2.0:1789776583.029761:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1c00/0xf13b8042cb884a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884a0c expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776583.029765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582720 00010000:00010000:2.0:1789776583.029794:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776583.029816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789776583.029826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876716449582720:12345-0@lo:39:umount.0 00000100:00100000:2.0:1789776583.029839:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3645:x1876716449582848:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (884us total) trans 0 rc 0/0 00000020:00000080:0.0:1789776583.029961:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88457b 00000100:00100000:2.0:1789776583.029969:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789776583.029971:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8a5cedec5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789776583.030010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc456a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449582848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776583.030199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1876716449582720:12345-0@lo:39:umount.0 Request processed in 372us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776583.030219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1789776583.030229:0:6516:0:(genops.c:885:class_export_put()) final put ffff8a5cedec2000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1789776583.030397:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cedd4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789776583.030412:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449582720:0@lo:39:umount.0 00000020:00000080:0.0:1789776583.030434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cedec2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789776583.030480:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cedec5800 for lustre-MDT0000 00000100:00080000:2.0:1789776583.030550:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776583.030554:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789776583.030558:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789776583.030766:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776583.034705:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.034726:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.034814:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.034829:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.034854:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776583.035003:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035011:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035018:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035040:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035061:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776583.035069:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035075:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035082:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035088:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035093:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776583.035161:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776583.035169:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035176:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035182:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.035188:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035432:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035443:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776583.035447:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035457:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776583.035474:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776583.035480:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776583.035482:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789776583.035485:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789776583.035551:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035632:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776583.035661:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035669:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342d600/0xf13b8042cb88491e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884925 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035684:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789776583.035688:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035694:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc25f9800 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776583.035697:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035704:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776583.035710:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776583.035724:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789776583.035727:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789776583.035729:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789776583.035745:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035750:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776583.035756:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035761:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc25f9800/0xf13b8042cb884c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c7b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035769:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776583.035772:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035777:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc0031800 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776583.035780:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035786:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776583.035791:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776583.035796:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776583.035798:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1789776583.035808:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.035818:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776583.035833:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776583.036535:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776583.036611:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1789776583.036618:0:15201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1789776583.036623:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789776583.036667:0:15201:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789776583.036671:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789776583.036676:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776583.036681:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789776583.036689:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a5cfc2ec800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776583.036696:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a5cf5cef800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776583.036701:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a5cf514f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776583.036705:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a5cd0edc800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789776583.036714:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a5bc24d4000 da875f9e-f31d-49b9-bb9b-3e43b9776cb6 192.168.204.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776583.036719:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a5bc31ad000 1c6b552f-1300-40e3-a848-4343cb28ffe2 192.168.204.27@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1789776583.036725:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a5cc81fcd28) has exports, disconnecting them 00010000:00010000:0.0:1789776583.036727:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc0031800/0xf13b8042cb8844da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8844e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789776583.036731:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a5cfc2ec800), last request at 1789776579 00000020:00000080:2.0:1789776583.036740:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884892 00010000:00010000:0.0:1789776583.036747:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776583.036750:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776583.036753:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776583.036761:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2e9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789776583.036771:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449582976:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789776583.036813:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cfc2ec800): rc 0 00000020:00000080:2.0:1789776583.036817:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cfc2ec800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789776583.036826:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a5cf5cef800), last request at 1789776579 00000020:00000080:2.0:1789776583.036829:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884773 00000100:00080000:2.0:1789776583.036835:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ceb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789776583.036847:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cf5cef800): rc 0 00000020:00000080:2.0:1789776583.036850:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cf5cef800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789776583.036953:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a5cf514f000), last request at 1789776367 00000020:00000080:2.0:1789776583.036965:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88468c 00000100:00080000:2.0:1789776583.036969:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc244000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789776583.036976:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cf514f000): rc 0 00000020:00000080:2.0:1789776583.036978:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cf514f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789776583.036996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc2ec800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789776583.037041:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5cef800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789776583.037060:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc2e9800 for lustre-MDT0000 00000020:00000080:1.0:1789776583.037064:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf5ceb800 for lustre-MDT0000 00010000:00010000:1.0:1789776583.037076:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789776583.037147:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a5cd0edc800), last request at 1789776367 00000020:00000080:2.0:1789776583.037151:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884638 00000100:00080000:2.0:1789776583.037155:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0f5f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776583.037165:0:15201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789776583.037237:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cd0edc800): rc 0 00000004:00000080:2.0:1789776583.037243:0:15201:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaed6c16cfae0 00000100:00080000:2.0:1789776583.037260:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789776583.037263:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1789776583.037485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776583.037638:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776583.037648:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449583104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776583.037682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776583.037715:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776583.037722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449583232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776583.037746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776583.037778:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449582976 00000100:00100000:0.0:1789776583.037785:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449582976 00000100:00100000:0.0:1789776583.037862:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583104 00000100:00100000:0.0:1789776583.037866:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583104 00000100:00100000:0.0:1789776583.037880:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583232 00000100:00100000:0.0:1789776583.037882:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583232 00000100:00100000:0.0:1789776583.037897:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776583.037905:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+25:3643:x1876716449582976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776583.037917:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776583.037955:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342dc00/0xf13b8042cb884925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb88491e expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776583.037970:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789776583.038072:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789776583.038091:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5ce9c12000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789776583.038736:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776583.038749:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+24:3643:x1876716449583104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776583.038761:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776583.038777:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f8a00/0xf13b8042cb884c7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884c74 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776583.038790:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776583.038804:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+23:3643:x1876716449582976:12345-0@lo:103:ldlm_bl.0 Request processed in 897us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776583.038813:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776583.038832:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3643:x1876716449583104:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776583.038839:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776583.038845:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789776583.038860:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+22:3646:x1876716449583232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776583.038870:0:7458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776583.038880:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0030200/0xf13b8042cb8844e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8844da expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776583.038888:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583360:0@lo:39:umount.0 00010000:00010000:0.0:1789776583.038891:0:7458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776583.038937:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3646:x1876716449583232:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776583.038945:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776583.038949:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789776583.039006:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776583.039074:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789776583.039078:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00010000:00010000:3.0:1789776583.039091:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1789776583.039092:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1789776583.039101:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.039110:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf1200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776583.039114:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.039123:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776583.039129:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776583.039135:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789776583.039138:0:7925:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789776583.039141:0:7925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:2.0:1789776583.039167:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1789776583.039175:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789776583.039181:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ce8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789776583.039183:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1789776583.039196:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789776583.039200:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00010000:00010000:3.0:1789776583.039209:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776583.039210:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1789776583.039218:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1200/0xf13b8042cb884a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a21 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.039231:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776583.039233:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776583.039241:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776583.039248:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776583.039259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449583488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776583.039280:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583616:0@lo:9:umount.0 00000100:00100000:2.0:1789776583.039309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776583.039341:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583616 00000100:00100000:2.0:1789776583.039346:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583616 00000100:00100000:2.0:1789776583.039383:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789776583.039389:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876716449583616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789776583.039408:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88480d 00000100:00080000:2.0:1789776583.039414:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc24b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776583.039452:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1789776583.039453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776583.039508:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776583.039525:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583488 00000100:00100000:3.0:1789776583.039529:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583488 00000100:00100000:3.0:1789776583.039638:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776583.039647:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+20:3645:x1876716449583488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776583.039655:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776583.039666:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342de00/0xf13b8042cb884a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884a1a expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.039677:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776583.039708:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72+19:3645:x1876716449583488:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776583.039715:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776583.039756:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449583488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776583.039783:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3642:x1876716449583616:12345-0@lo:9:umount.0 Request processed in 393us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776583.039790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776583.040341:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583360 00000100:00100000:0.0:1789776583.040347:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583360 00000100:00100000:0.0:1789776583.040395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789776583.040404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876716449583360:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789776583.040424:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8846af 00000100:00080000:0.0:1789776583.040431:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776583.040519:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789776583.040710:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3642:x1876716449583360:12345-0@lo:39:umount.0 Request processed in 308us (1768us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789776583.040717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789776583.040751:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3646:1876716449583232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776583.040782:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776583.040799:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449583104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776583.040808:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449582976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776583.041481:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776583.041887:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776583.041897:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789776583.041932:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3451800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789776583.041970:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a5cc81fcd28) has no exports 00000020:00000080:1.0:1789776583.042419:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf514f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789776583.042477:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc244000 for lustre-MDT0000 00000100:00100000:2.0:1789776583.043514:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583744:0@lo:9:umount.0 00000100:00100000:2.0:1789776583.043585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789776583.043633:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789776583.043663:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789776583.043666:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776583.043669:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583616:0@lo:9:umount.0 00000100:00080000:2.0:1789776583.043685:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5ce9c12000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789776583.043689:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583360:0@lo:39:umount.0 00000100:00100000:1.0:1789776583.044333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583744 00000100:00100000:1.0:1789776583.044342:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583744 00000100:00100000:1.0:1789776583.044408:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776583.044419:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876716449583744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789776583.044445:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88494f 00000100:00080000:1.0:1789776583.044458:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8a5bc31ac800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789776583.044521:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1789776583.044544:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776583.044680:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3642:x1876716449583744:12345-0@lo:9:umount.0 Request processed in 262us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776583.044689:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789776583.044697:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3451800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789776583.044712:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789776583.044714:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1789776583.044718:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776583.044719:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449583744:0@lo:9:umount.0 00000001:00100000:1.0:1789776583.045918:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789776583.045938:0:6495:0:(genops.c:885:class_export_put()) final put ffff8a5cd0edc800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789776583.045962:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00080000:1.0:1789776583.045970:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789776583.045974:0:6495:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d4000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00100000:1.0:1789776583.045980:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776583.046174:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0edc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00080000:1.0:1789776583.046339:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789776583.046353:0:6495:0:(genops.c:885:class_export_put()) final put ffff8a5bc31ad000/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776583.046471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d4000/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 for lustre-MDT0000 00000020:00000080:0.0:1789776583.046551:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd0f5f000 for lustre-MDT0000 00000020:00000080:0.0:1789776583.046557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc31ad000/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-MDT0000 00000020:00000080:0.0:1789776583.046753:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc24d6800 for lustre-MDT0000 00000020:00000080:0.0:1789776583.046759:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc31a8800 for lustre-MDT0000 00000020:00080000:3.0:1789776583.055238:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a5cc81fcd28) has no exports 00000020:00000080:3.0:1789776583.124287:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884535 00000020:00000080:3.0:1789776583.124305:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cedcdd000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789776583.124467:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:1.0:1789776583.124713:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789776583.128014:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.128292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cedcdd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789776583.128335:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776583.128341:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a5cc81f99b8) has no exports 00000020:00000080:2.0:1789776583.131838:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88452e 00000020:00000080:2.0:1789776583.132193:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cedcdd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789776583.135027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cedcdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789776583.136123:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776583.136539:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789776583.136546:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ce9c13800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789776583.136550:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ce9c13800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789776583.136560:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789776583.136709:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5bc309b9c0 - data ffff8a5cf8b555e8/ffff8a5bc241e800 00000020:01000000:2.0:1789776583.136843:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cc390e6c0 - data ffff8a5cf88d7ca8/ffff8a5cede9e400 00000001:00000004:2.0:1789776583.145048:0:15201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1789776583.213667:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789776583.213675:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789776583.213692:0:15201:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a5bc3e90000 x1876716449583360/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789776593 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776583.213726:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789776583.214805:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789776583.214811:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:0.0:1789776583.214823:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789776583.214825:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789776583.218843:0:8523:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789776583.218851:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789776583.218863:0:8523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789776583.221243:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789776583.221251:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789776583.221278:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789776583.221281:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789776583.221752:0:9984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789776583.221757:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789776583.221768:0:9984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789776583.223020:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8844fd 00000020:00000080:0.0:1789776583.223031:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789776583.224591:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789776583.231996:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884512 00000020:00000080:0.0:1789776583.232011:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ce9c11000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789776583.232031:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789776583.232036:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.232044:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789776583.232048:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a5cc81fb370) has no exports 00000004:01000000:0.0:1789776583.232224:0:15201:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789776583.232233:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884948 00000020:00000080:0.0:1789776583.232237:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5bc31ae800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789776583.232241:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789776583.232244:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.232253:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789776583.232256:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8a5cff3b3370) has no exports 00000020:00000080:0.0:1789776583.232263:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884941 00000020:00000080:0.0:1789776583.232267:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5bc3454800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789776583.232574:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ce9c11000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789776583.232583:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc31ae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789776583.232587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc3454800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789776583.232736:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789776583.232741:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789776583.232745:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789776583.232750:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789776583.232753:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776583.232832:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776583.232841:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776583.232847:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884806 00000020:00000080:0.0:1789776583.232851:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cfc24d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776583.237316:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc3451800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789776583.237341:0:8:0:(genops.c:885:class_export_put()) final put ffff8a5bc31aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776583.237344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc31aa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789776583.237354:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789776583.239708:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789776583.239719:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.239734:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789776583.239740:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a5cff3b4d28) has no exports 00000020:00000080:0.0:1789776583.239750:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8847ff 00000020:00000080:0.0:1789776583.239758:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cfc249000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789776583.240198:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789776583.240203:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789776583.240216:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:0.0:1789776583.240221:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789776583.240223:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776583.240255:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776583.240263:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789776583.240278:0:15201:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789776583.240297:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884693 00000020:00000080:0.0:1789776583.240302:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ceef83000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789776583.240306:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789776583.240310:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.240313:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789776583.240315:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a5cfaef99b8) has no exports 00000020:00000080:0.0:1789776583.240319:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884677 00000020:00000080:0.0:1789776583.240322:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ceef82800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789776583.241239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc24d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789776583.241252:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc249000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789776583.241258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf5ce8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789776583.241264:0:8:0:(genops.c:885:class_export_put()) final put ffff8a5cfc24c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776583.241268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc24c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789776583.241272:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776583.241353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceef83000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789776583.241358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceef82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789776583.246640:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789776583.246650:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789776583.246655:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789776583.246664:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789776583.246726:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776583.246748:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776583.246774:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776583.246778:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776583.246783:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776583.246787:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789776583.246799:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776583.246897:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884519 00000020:00000080:1.0:1789776583.246904:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ce9c13000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789776583.246909:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789776583.246912:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776583.246927:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789776583.246931:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a5cc81f8000) has no exports 00000020:00000080:1.0:1789776583.246948:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776583.246952:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789776583.246955:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884520 00000020:00000080:1.0:1789776583.246960:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5ce9c15800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789776583.246968:0:15201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cdb443800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789776583.246971:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cdb443800 3 00000020:01000004:1.0:1789776583.246974:0:15201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a5cdb443800 from lustre-MDT0000 00000020:00000080:1.0:1789776583.246990:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776583.246994:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789776583.246996:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc2000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789776583.246997:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789776583.247003:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789776583.247031:0:15201:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789776583.247036:0:15201:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789776583.247039:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789776583.247041:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776583.247044:0:15201:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789776583.247050:0:15201:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a5cf0f4f000 fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776583.247055:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a5cfaefb370) has exports, disconnecting them 00000020:00080000:1.0:1789776583.247059:0:15201:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a5cf0f4f000), last request at 1789776351 00000020:00000080:1.0:1789776583.247081:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8844be 00000020:00010000:1.0:1789776583.247099:0:15201:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a5cf0f4f000: total 2 00000100:00080000:1.0:1789776583.247103:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8a5cf0f4a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789776583.247113:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cf0f4f000): rc 0 00000020:00080000:1.0:1789776583.247117:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a5cfaefb370) has no exports 00000020:00010000:3.0:1789776583.247186:0:6504:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a5cf0f4f000: total 2 00010000:00010000:3.0:1789776583.247225:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a5cf0f4f000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789776583.247256:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257c00/0xf13b8042cb8849e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849e2 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247274:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342d200/0xf13b8042cb8849db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849d4 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247285:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf0000/0xf13b8042cb884a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849fe expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247297:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc0031200/0xf13b8042cb8845ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8845b3 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247311:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf0e00/0xf13b8042cb8849f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849f0 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247321:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc3bf1e00/0xf13b8042cb8845c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8845c1 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247334:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342cc00/0xf13b8042cb884c51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884c4a expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247343:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc25f8e00/0xf13b8042cb884c5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884c58 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247353:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc342d800/0xf13b8042cb884a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884a28 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247376:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1000/0xf13b8042cb8849bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849b8 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247385:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2e00/0xf13b8042cb884c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb884c66 expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247397:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc256800/0xf13b8042cb8849cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8849c6 expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247409:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb8848df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf13b8042cb8848d8 expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776583.247420:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a5cf0f4f000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789776583.247435:0:6504:0:(genops.c:885:class_export_put()) final put ffff8a5cf0f4f000/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 00010000:00010000:3.0:1789776583.247443:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776583.247445:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776583.247447:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776583.247481:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a5cd8fac600:6510] 1 exiting: rc = 0 00000020:00000080:3.0:1789776583.247590:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5ce9c12000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789776583.247597:0:8:0:(genops.c:885:class_export_put()) final put ffff8a5ceef85800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789776583.247599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceef85800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789776583.247604:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789776583.247640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ce9c13000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789776583.247644:0:8:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc5800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789776583.247645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789776583.247663:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789776583.247687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ce9c15800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789776583.247691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf0f4f000/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 for MGS 00000020:00000080:3.0:1789776583.247720:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf0f4a000 for MGS 00000100:00100000:1.0:1789776583.248578:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a5cc7599a00:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1789776583.248714:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a5cd8fac800:6511] 2 exiting: rc = 0 00000100:00100000:1.0:1789776583.248822:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248830:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248836:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248842:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248848:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248853:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248859:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248865:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248871:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248878:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248884:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248890:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248896:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248902:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248908:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248913:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248930:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248936:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248942:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248947:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248952:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248958:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248964:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248969:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248974:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248979:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248984:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.248990:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249005:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249011:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249017:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249022:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249027:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249032:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249038:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249043:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249048:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249053:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249058:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249064:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249070:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249075:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249081:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249099:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249106:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249111:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249116:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249121:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249125:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249131:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249136:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249142:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249147:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249155:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249160:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249166:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249170:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249174:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249179:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249184:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249189:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249194:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249198:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776583.249210:0:15201:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789776583.250232:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5bc21dea20 - data ffff8a5bc1c19510/ffff8a5bc31dac00 00000020:01000000:1.0:1789776583.250351:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cd91fb120 - data ffff8a5cf882f1b0/ffff8a5cdb62c800 00000020:00000080:1.0:1789776583.250809:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8844a2 00000020:00000080:1.0:1789776583.250818:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd8515800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789776583.250835:0:15201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cdb443800 from MGS, refs=2 00000020:01000004:1.0:1789776583.250839:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cdb443800 2 00000020:01000004:1.0:1789776583.250842:0:15201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a5cdb443800 from MGS 00000020:00000080:1.0:1789776583.250862:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776583.250868:0:15201:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789776583.250870:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd8515000/MGS 00000020:00000080:1.0:1789776583.250873:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd8515000/MGS for MGS 00000020:01000000:1.0:1789776583.250879:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789776583.250950:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789776583.250954:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776583.250960:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789776583.250965:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a5cedd49800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776583.250970:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8a5cfaf2cd28) has exports, disconnecting them 00000020:00080000:1.0:1789776583.250974:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a5cedd49800), last request at 1789776352 00000020:00000080:1.0:1789776583.250979:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88456d 00000020:00080000:1.0:1789776583.250988:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cedd49800): rc 0 00000020:00000080:1.0:1789776583.250993:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cedd49800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789776583.251200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd8515800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789776583.251209:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cedd49800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789776583.306752:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789776583.306762:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776583.306766:0:15201:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789776583.306774:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776583.306949:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776583.306958:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789776583.306965:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cdb443800 1 00000020:00000080:0.0:1789776583.306972:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884494 00000020:00000080:0.0:1789776583.306980:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cd8510800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789776583.306987:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789776583.306992:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776583.306996:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789776583.306999:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a5cfaf299b8) has no exports 00000020:00000080:3.0:1789776583.309099:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cedd4e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789776583.309115:0:38:0:(genops.c:885:class_export_put()) final put ffff8a5cd0edb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789776583.309119:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0edb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789776583.309132:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789776583.309217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd8510800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789776583.392400:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776583.392416:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789776583.392421:0:15201:0:(genops.c:885:class_export_put()) final put ffff8a5cdb442800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789776583.392426:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cdb442800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789776583.392432:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789776583.392587:0:15201:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a5cdb440000 00000020:02000400:3.0:1789776583.393584:0:15201:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789776584.162961:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776584.249164:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776584.249188:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449583872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776584.249253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776584.249302:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449583872 00000100:00100000:0.0:1789776584.249310:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449583872 00000100:00100000:0.0:1789776584.249375:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789776584.249385:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449583872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776584.249414:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789776584.249475:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449583872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776584.249483:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789776584.249715:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776584.249767:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449583872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776584.746770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449584384:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.746845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.746879:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449584896:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.746918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.746945:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789776584.746951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449584000:0@lo:400:kworker.0 00000400:00000100:3.0:1789776584.746971:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876716449584000 offset 0 length 224: 4 00000100:00100000:3.0:1789776584.746993:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449584512:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.747038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449584128:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.747095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449584640:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.747136:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789776584.747141:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449584256:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.747175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449584768:0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776584.747226:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584384 00000100:00100000:3.0:1789776584.747234:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584384 00000100:00100000:3.0:1789776584.747267:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584512 00000100:00100000:3.0:1789776584.747270:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584512 00000100:00100000:3.0:1789776584.747295:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584640 00000100:00100000:3.0:1789776584.747298:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584640 00000100:00100000:3.0:1789776584.747304:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584256 00000100:00100000:3.0:1789776584.747306:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584256 00000100:00100000:3.0:1789776584.747312:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584768 00000100:00100000:3.0:1789776584.747314:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584768 00000100:00100000:3.0:1789776584.747330:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789776584.747338:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449584512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747388:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449584512:12345-0@lo:400:kworker.0 Request processed in 50us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776584.747395:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789776584.747413:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789776584.747419:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449584768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747448:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449584768:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776584.747455:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789776584.747476:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789776584.747481:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876716449584384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789776584.747486:0:13443:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789776584.747545:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876716449584384:12345-0@lo:400:kworker.0 Request processed in 62us (699us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789776584.747550:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789776584.747562:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789776584.747566:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876716449584640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789776584.747571:0:13443:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789776584.747591:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876716449584640:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789776584.747595:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789776584.747605:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789776584.747608:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876716449584256:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789776584.747612:0:13443:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789776584.747630:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876716449584256:12345-0@lo:400:kworker.0 Request processed in 20us (470us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789776584.747635:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789776584.747655:0:8528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584896 00000100:00100000:3.0:1789776584.747659:0:8528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584896 00000100:00100000:3.0:1789776584.747687:0:8528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789776584.747692:0:8528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449584896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776584.747720:0:8528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449584896:12345-0@lo:400:kworker.0 Request processed in 27us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776584.747727:0:8528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789776584.747747:0:7805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449584128 00000100:00100000:3.0:1789776584.747750:0:7805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449584128 00000100:00100000:3.0:1789776584.747770:0:7805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789776584.747781:0:7805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1876716449584128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789776584.747787:0:7805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789776584.747813:0:7805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1876716449584128:12345-0@lo:400:kworker.0 Request processed in 32us (738us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789776584.747819:0:7805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1789776584.747846:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776584.747852:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776584.747882:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789776584.747903:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789776584.747907:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789776584.751230:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449585024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776584.751301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776584.751388:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585024 00000100:00100000:1.0:1789776584.751396:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585024 00000100:00100000:1.0:1789776584.751447:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789776584.751456:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449585024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776584.751486:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789776584.751562:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449585024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776584.751585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789776584.751630:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449585024:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789776584.756054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a5bc3d4ea00 x1876716449584512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776584.756073:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449584512:0@lo:400:kworker.0 00000100:00080000:2.0:1789776584.756088:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789776584.756093:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789776584.756097:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789776584.756104:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776584.756108:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00080000:2.0:1789776584.756116:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a5bc1a61800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776584.756153:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e92300 x1876716449585152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776584.756176:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789776584.756208:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449584896:0@lo:400:kworker.0 00000100:00100000:1.0:1789776584.756315:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449585152:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789776584.756385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776584.759387:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585152 00000100:00100000:2.0:1789776584.759403:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585152 00000100:00100000:2.0:1789776584.759462:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789776584.759470:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876716449585152:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789776584.759523:0:13443:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789776584.759617:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876716449585152:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 146us (3232us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776584.759626:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789776584.759806:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776584.759812:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789776584.759816:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449585152:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789776584.784085:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776584.784106:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 188 00000100:00080000:3.0:1789776584.784117:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a5cf514e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776584.784323:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e92300 x1876716449585280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776584.784356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449584256:0@lo:400:kworker.0 00010000:00080000:2.0:1789776584.784395:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a5bc3d4df80 x1876716449584768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776584.784406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449584768:0@lo:400:kworker.0 00000100:00080000:2.0:1789776584.784420:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789776584.784424:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5ceee12800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789776584.784427:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789776584.784432:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5ceee12800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776584.784435:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 188 00000100:00080000:2.0:1789776584.784460:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a5ceee12800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776584.784475:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e91880 x1876716449585408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776584.784486:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449584128:0@lo:400:kworker.0 00000100:00080000:2.0:1789776584.784526:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789776584.784530:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789776584.784533:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789776584.784535:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776584.784539:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 222 00000100:00080000:2.0:1789776584.784543:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a5cd93f7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776584.784556:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e91500 x1876716449585536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776584.784565:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449584640:0@lo:400:kworker.0 00000100:00100000:1.0:1789776584.784671:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449585280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789776584.784738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776584.784771:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449585408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789776584.784797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776584.784827:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449585536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789776584.784848:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776584.784920:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585408 00000100:00100000:2.0:1789776584.784927:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585408 00000100:00100000:2.0:1789776584.784973:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789776584.784980:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449585408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789776584.784999:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789776584.785044:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449585408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 63us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776584.785051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1789776584.785185:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5ceee12800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776584.785190:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776584.785193:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449585408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789776584.791724:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585280 00000100:00100000:3.0:1789776584.791738:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585280 00000100:00100000:3.0:1789776584.791782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585536 00000100:00100000:3.0:1789776584.791785:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585536 00000100:00100000:3.0:1789776584.791807:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789776584.791815:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449585280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789776584.791837:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789776584.791937:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449585280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 122us (7198us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776584.792963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789776584.792972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449585536:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789776584.792990:0:6516:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789776584.793068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449585536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 83us (8206us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776584.793076:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789776584.793279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789776584.793337:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776584.793342:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789776584.793346:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449585280:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789776584.793372:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776584.793375:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789776584.793379:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449585536:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1789776585.190447:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789776585.765445:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789776585.765454:0:9510:0:(genops.c:885:class_export_put()) final put ffff8a5bc31aa000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789776585.765479:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:3.0:1789776585.765482:0:9510:0:(genops.c:885:class_export_put()) final put ffff8a5cd884d800/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776585.766172:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc31aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789776585.766213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd884d800/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-OST0001 00000020:00000080:0.0:1789776585.766244:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc31ac800 for lustre-OST0001 00000020:00000080:0.0:1789776585.766249:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd884f000 for lustre-OST0001 00000001:00100000:0.0:1789776585.767451:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789776585.767457:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5cfc249800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789776585.767474:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776585.767477:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5cd884e800/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:2.0:1789776585.767573:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc249800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789776585.767609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd884e800/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-OST0000 00000020:00000080:2.0:1789776585.767627:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc24b000 for lustre-OST0000 00000020:00000080:2.0:1789776585.767631:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd884c000 for lustre-OST0000 00000001:00100000:2.0:1789776585.767824:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789776585.767833:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789776585.767835:0:7447:0:(genops.c:885:class_export_put()) final put ffff8a5cfc243800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789776585.767849:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00080000:2.0:1789776585.767854:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789776585.767855:0:7447:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d1800/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 00000001:00100000:2.0:1789776585.767860:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c6b552f-1300-40e3-a848-4343cb28ffe2 00000001:00080000:2.0:1789776585.767864:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789776585.767865:0:7447:0:(genops.c:885:class_export_put()) final put ffff8a5bc2137000/1c6b552f-1300-40e3-a848-4343cb28ffe2 00000020:00000080:0.0:1789776585.767970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc243800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789776585.768009:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d1800/da875f9e-f31d-49b9-bb9b-3e43b9776cb6 for lustre-MDT0001 00000020:00000080:0.0:1789776585.768081:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc2137000/1c6b552f-1300-40e3-a848-4343cb28ffe2 for lustre-MDT0001 00000020:00000080:0.0:1789776585.768109:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc2ed800 for lustre-MDT0001 00000020:00000080:0.0:1789776585.768113:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc24d6000 for lustre-MDT0001 00000020:00000080:0.0:1789776585.768116:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc241000 for lustre-MDT0001 00010000:00010000:0.0:1789776586.212987:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776587.234756:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789776587.628979:0:15401:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789776587.640056:0:15401:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789776587.640131:0:15401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.640149:0:15401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.640156:0:15401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.640165:0:15401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.640206:0:15401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776587.640212:0:15401:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789776587.640244:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776587.640250:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789776587.640257:0:15401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789776587.640264:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789776587.640271:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776587.640273:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789776587.640276:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789776587.640398:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776587.640407:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776587.640416:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:3.0:1789776587.640420:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776587.640430:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776587.640439:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776587.640446:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789776587.640448:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789776587.640451:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789776587.640525:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776587.640533:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776587.640559:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776587.640574:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257200/0xf13b8042cb8849f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8849f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776587.640586:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776587.640588:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776587.640590:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776587.640613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449585664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776587.640699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776587.640785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585664 00000100:00100000:3.0:1789776587.640793:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585664 00000100:00100000:3.0:1789776587.640856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776587.640865:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876716449585664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789776587.640872:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776587 with bad export cookie 17382628211137463486 00010000:00010000:2.0:1789776587.643872:0:15401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643898:0:15401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643906:0:15401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643913:0:15401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643939:0:15401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776587.643946:0:15401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643952:0:15401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643985:0:15401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.643991:0:15401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644006:0:15401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776587.644014:0:15401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644022:0:15401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644029:0:15401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644036:0:15401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644051:0:15401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789776587.644057:0:15401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644064:0:15401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644070:0:15401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644087:0:15401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776587.644096:0:15401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789776587.644100:0:15401:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789776587.644137:0:15401:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789776587.644142:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789776587.644148:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776587.644155:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789776587.644164:0:15401:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a5bc252e000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776587.644170:0:15401:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a5cf5cee800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776587.644176:0:15401:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8a5cc8c60000) has exports, disconnecting them 00000020:00080000:2.0:1789776587.644181:0:15401:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a5bc252e000), last request at 1789776584 00000020:00000080:2.0:1789776587.644190:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8848a0 00000100:00080000:2.0:1789776587.644212:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2528000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789776587.644273:0:15401:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5bc252e000): rc 0 00000020:00000080:2.0:1789776587.644276:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5bc252e000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789776587.644289:0:15401:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a5cf5cee800), last request at 1789776584 00000020:00000080:2.0:1789776587.644292:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88477a 00000100:00080000:2.0:1789776587.644298:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5cea000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789776587.644305:0:15401:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cf5cee800): rc 0 00000020:00000080:2.0:1789776587.644307:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5cee800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789776587.644317:0:15401:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaed6c1667ae0 00000100:00080000:2.0:1789776587.644343:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776587.644349:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789776587.644672:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789776587.644688:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644697:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776587.644701:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644711:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776587.644719:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776587.644724:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776587.644727:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789776587.644729:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789776587.644778:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644784:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776587.644816:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644823:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257600/0xf13b8042cb8849fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884a05 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644850:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789776587.644853:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644859:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1800 already unused, calling callback (ffffffffc11fbc20) 00010000:00010000:1.0:1789776587.644861:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776587.644867:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776587.644868:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644875:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2000 already unused, calling callback (ffffffffc11fbc20) 00010000:00010000:0.0:1789776587.644876:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776587.644878:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776587.644884:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644886:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776587.644890:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776587.644892:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789776587.644894:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:1.0:1789776587.644901:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776587.644907:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789776587.644909:0:7925:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789776587.644911:0:7925:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789776587.644911:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644916:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776587.644923:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644929:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776587.644933:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644934:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644941:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb884c66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb884c6d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644941:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1800/0xf13b8042cb8848d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8848df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644950:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776587.644953:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776587.644953:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776587.644955:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776587.644957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776587.644959:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f800 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776587.644962:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.644968:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776587.644974:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776587.644983:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449585920:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789776587.644988:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789776587.644990:0:7925:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789776587.644992:0:7925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789776587.645003:0:7925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.645009:0:7925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776587.645015:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.645021:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f800/0xf13b8042cb8845c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf13b8042cb8845c8 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776587.645032:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776587.645033:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776587.645035:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776587.646662:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776587.646734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776587.646748:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449586048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776587.646777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776587.646844:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449585920 00000100:00100000:0.0:1789776587.646853:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449585920 00000100:00100000:0.0:1789776587.646895:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449586048 00000100:00100000:0.0:1789776587.646898:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449586048 00000100:00100000:0.0:1789776587.646913:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776587.646921:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5ccfa8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876716449585920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789776587.646928:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776587 with bad export cookie 17382628211137463486 00000100:00100000:0.0:1789776587.646982:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5ccfa8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876716449585920:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789776587.646989:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776587.647007:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789776587.647011:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876716449586048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789776587.647015:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776587 with bad export cookie 17382628211137463486 00000100:00100000:0.0:1789776587.647039:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876716449586048:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (262us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789776587.647044:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789776587.647079:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789776587.647085:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789776587.647089:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789776587.647204:0:15401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789776587.647212:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5ceee12800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789776587.649589:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789776587.651632:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc252e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789776587.651740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5cee800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789776587.651771:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc2528000 for lustre-MDT0001 00000020:00000080:2.0:1789776587.651778:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf5cea000 for lustre-MDT0001 00000100:00100000:3.0:1789776587.656858:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876716449585664:12345-0@lo:103:ldlm_bl.0 Request processed in 15984us (16151us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789776587.656876:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789776587.663883:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789776587.663893:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789776587.663917:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789776587.663986:0:15401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789776587.664030:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789776587.664052:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789776587.664055:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789776587.664068:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789776587.664154:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449586304:0@lo:9:umount.0 00000100:00100000:3.0:1789776587.664269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776587.664342:0:15401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789776587.664352:0:15401:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2ef000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789776587.664370:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449586432:0@lo:9:umount.0 00000100:00100000:3.0:1789776587.664399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789776587.666510:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a5cc8c60000) has no exports 00000100:00080000:0.0:1789776587.680008:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.127@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789776587.680017:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789776587.680031:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5bc3d4d500 x1876716449584000/t0(0) o400->MGC192.168.204.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789776600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776587.680051:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff498e00 x1876716449585664/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776603 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776587.680062:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff349c00 x1876716449585920/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776603 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776587.680102:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff35c700 x1876716449586048/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776603 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776587.680172:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:0:1876716449586176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776587.680199:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3645:1876716449585664:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789776587.680423:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789776587.680427:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789776587.680429:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789776587.680435:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776587.680442:0:3643:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:0.0:1789776587.680454:0:3643:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff8a5cc8c83000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776587.680673:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348700 x1876716449586560/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776587.680712:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449585920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776587.680720:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449584000:0@lo:400:kworker.0 00000100:00100000:0.0:1789776587.680740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3643:1876716449586048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776587.681170:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449586560:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1789776587.681238:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876716449586560 offset 0 length 520: 4 00000100:00100000:1.0:1789776587.684369:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:0:1876716449585792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776587.684445:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449586304 00000100:00100000:1.0:1789776587.684457:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449586304 00000100:00100000:1.0:1789776587.684589:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449586432 00000100:00100000:1.0:1789776587.684594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449586432 00000100:00100000:1.0:1789776587.684630:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776587.684642:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876716449586304:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789776587.684685:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8847c7 00000100:00080000:1.0:1789776587.684700:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5cec000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789776587.684712:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776587.684740:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876716449586432:12345-0@lo:9:umount.0 00000001:00000004:1.0:1789776587.684764:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00000080:2.0:1789776587.684774:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884917 00000100:00080000:2.0:1789776587.684787:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a5bc252c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776587.684850:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789776587.685057:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3642:x1876716449586432:12345-0@lo:9:umount.0 Request processed in 331us (20656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.685068:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789776587.685128:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfc2ef000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789776587.685144:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789776587.685147:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776587.685151:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449586432:0@lo:9:umount.0 00000100:00080000:3.0:1789776587.685196:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776587.685203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776587.686416:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3642:x1876716449586304:12345-0@lo:9:umount.0 Request processed in 1769us (22140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776587.686454:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789776587.687233:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789776587.687263:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789776587.687266:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776587.687272:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449586304:0@lo:9:umount.0 00010000:00010000:1.0:1789776587.687350:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776587.687362:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789776587.699309:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a5cc8c60000) has no exports 00000020:01000000:3.0:1789776587.772435:0:15401:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cedde3480 - data ffff8a5cf8863870/ffff8a5cf5e0e800 00000020:01000000:3.0:1789776587.773243:0:15401:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cfc08b6c0 - data ffff8a5cf89ce5e8/ffff8a5cf5000400 00000001:00000004:3.0:1789776587.788346:0:15401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789776587.824666:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776587.824675:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789776587.824683:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789776587.827108:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789776587.827114:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789776587.827134:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776587.827137:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789776587.827559:0:8515:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789776587.827564:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789776587.827575:0:8515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789776587.828837:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789776587.828843:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789776587.828861:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776587.828864:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789776587.829092:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789776587.829097:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789776587.829107:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789776587.834448:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8845e4 00000020:00000080:1.0:1789776587.834459:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5163800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789776587.835400:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5163800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789776587.839095:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8845f9 00000020:00000080:1.0:1789776587.839109:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5166000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789776587.839118:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789776587.839123:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776587.839129:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5166000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789776587.839131:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789776587.839135:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a5cc8c64d28) has no exports 00000004:01000000:1.0:1789776587.839303:0:15401:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789776587.839312:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884902 00000020:00000080:1.0:1789776587.839317:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5bc2528800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789776587.839331:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789776587.839335:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776587.839342:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789776587.839344:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8a5cff3b19b8) has no exports 00000020:00000080:1.0:1789776587.839350:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8848fb 00000020:00000080:1.0:1789776587.839353:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cfc2ea800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789776587.839524:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc2528800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789776587.839531:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc2ea800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789776587.839729:0:15401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789776587.839734:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789776587.839739:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789776587.839959:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789776587.839963:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789776587.840057:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776587.840064:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789776587.840068:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8847c0 00000020:00000080:1.0:1789776587.840072:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789776587.840076:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789776587.840079:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776587.840082:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789776587.840084:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8a5cfaf28000) has no exports 00000020:00000080:1.0:1789776587.840087:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8847b9 00000020:00000080:1.0:1789776587.840089:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cd93f4000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789776587.840162:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cfc2ef000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789776587.840169:0:38:0:(genops.c:885:class_export_put()) final put ffff8a5bc252a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789776587.840171:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc252a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789776587.840297:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00010000:01000000:1.0:1789776587.843516:0:15401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789776587.843524:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789776587.843528:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789776587.843535:0:15401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789776587.843537:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789776587.843581:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776587.843591:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789776587.843604:0:15401:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789776587.843610:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88462a 00000020:00000080:1.0:1789776587.843618:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5ceef84800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789776587.843624:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789776587.843631:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776587.843635:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789776587.843638:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a5cfaef8000) has no exports 00000020:00000080:1.0:1789776587.843644:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884623 00000020:00000080:1.0:1789776587.843647:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5ceee15000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789776587.845378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789776587.845391:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd93f4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789776587.845397:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd93f0800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789776587.845415:0:38:0:(genops.c:885:class_export_put()) final put ffff8a5cfc24f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789776587.845417:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc24f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789776587.845422:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776587.845470:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceef84800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789776587.845475:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceee15000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789776587.845521:0:15401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789776587.845525:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776587.845529:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789776587.845535:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776587.845554:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5ceee12800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789776587.845583:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776587.845591:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776587.845594:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5ceee13000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789776587.845597:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ceee13000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789776587.845601:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776587.845726:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776587.845731:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776587.845734:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5ce9c11800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789776587.845736:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5ce9c11800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789776587.845740:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776587.845969:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884600 00000020:00000080:0.0:1789776587.845976:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5160000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789776587.845991:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789776587.845994:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776587.846000:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789776587.846003:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8a5cc8c619b8) has no exports 00000020:00000080:0.0:1789776587.846020:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776587.846024:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789776587.846028:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884607 00000020:00000080:0.0:1789776587.846038:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5160800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789776587.846047:0:15401:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cd0f5c800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789776587.846050:0:15401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cd0f5c800 2 00000020:01000004:0.0:1789776587.846053:0:15401:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a5cd0f5c800 from lustre-MDT0001 00000020:00000080:0.0:1789776587.846070:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776587.846073:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789776587.846076:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5167800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789776587.846078:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5167800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789776587.846086:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789776587.846119:0:15401:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789776587.846123:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789776587.846126:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776587.846129:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789776587.846135:0:15401:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a5cf514c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789776587.846140:0:15401:0:(genops.c:1553:class_disconnect_exports()) OBD device 15 (ffff8a5cfc0d4d28) has exports, disconnecting them 00000020:00080000:0.0:1789776587.846145:0:15401:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a5cf514c000), last request at 1789776367 00000020:00000080:0.0:1789776587.846148:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884685 00000020:00080000:0.0:1789776587.846158:0:15401:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5cf514c000): rc 0 00000020:00000080:0.0:1789776587.846161:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf514c000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789776587.846430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5160000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789776587.846436:0:37:0:(genops.c:885:class_export_put()) final put ffff8a5cf5163000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789776587.846438:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5163000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789776587.846442:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789776587.846628:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5160800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789776587.846633:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf514c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789776587.864590:0:15401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789776587.864598:0:15401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776587.864605:0:15401:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789776587.864613:0:15401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789776587.864641:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf514e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789776587.864801:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776587.864809:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789776587.864815:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cf5149000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789776587.864819:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cf5149000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789776587.864841:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789776587.864919:0:15401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cd0f5c800 1 00000020:00000080:2.0:1789776587.864926:0:15401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884597 00000020:00000080:2.0:1789776587.864932:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc2800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789776587.864951:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789776587.864960:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789776587.864973:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776587.864980:0:15401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776587.864984:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a5cfaefcd28) has no exports 00000020:00000080:2.0:1789776587.934038:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776587.934052:0:15401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789776587.934057:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cd0f5c000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789776587.934062:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0f5c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789776587.934071:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789776587.934199:0:15401:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a5cd0f5b000 00000020:01000000:2.0:1789776587.934219:0:15401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789776587.934223:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776587.934228:0:15401:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776587.934231:0:15401:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a5cfaf2b370) has no exports 00000100:00100000:0.0:1789776587.936373:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a5cd9a27600:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1789776587.939438:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a5cd8f9fe00:6518] 2 exiting: rc = 0 00000100:00100000:1.0:1789776587.939600:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a5cd9a27e00:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1789776587.939688:0:13443:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a5bc31a0c00:13443] 4 exiting: rc = 0 00000100:00100000:1.0:1789776587.941220:0:10345:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a5bc10fee00:10345] 3 exiting: rc = 0 00000100:00100000:2.0:1789776587.941346:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941356:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941362:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941367:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941372:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941377:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941382:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941387:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941392:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941398:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941404:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941409:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941414:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941420:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941426:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941432:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941438:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941444:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941463:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941468:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941474:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941480:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941485:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941516:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941524:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941530:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941535:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941541:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941547:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941552:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941557:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941563:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941568:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941573:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941579:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941585:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941592:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941598:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941604:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941609:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941615:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941621:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941627:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941632:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941638:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941644:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941650:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941656:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941661:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941667:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941672:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941678:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941683:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941696:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941701:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941707:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941713:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941718:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941724:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941729:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941735:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941740:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941745:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.941751:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.948391:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a5cfae12a00:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1789776587.950444:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a5cd9b3ca00:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1789776587.954158:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954171:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954178:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954184:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954190:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954197:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954203:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954209:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954214:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954219:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954225:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954230:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954237:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954242:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954247:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954252:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954256:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954262:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954267:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954272:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954277:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954296:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954301:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954307:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954312:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954317:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954321:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954327:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954332:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954337:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954342:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954347:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954351:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954356:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954361:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954365:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954370:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954375:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954380:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954384:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954389:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954394:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954398:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954403:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954408:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954413:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954418:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954423:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954428:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954432:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954436:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954440:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954445:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954449:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954454:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954459:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954472:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954476:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954481:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954486:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954507:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954512:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954517:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.954523:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.955041:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a5cd92a1800:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1789776587.960604:0:7805:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8a5cfc259200:7805] 2 exiting: rc = 0 00000100:00100000:2.0:1789776587.965287:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a5cd92a1000:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1789776587.967842:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967853:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967862:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967869:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967875:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967881:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967886:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967891:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967897:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967903:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967923:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967930:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967935:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967942:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967947:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967953:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967959:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967965:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967971:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967977:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967982:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.967988:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968007:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968015:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968020:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968027:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968048:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968053:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968060:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968066:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968072:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968078:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968084:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968089:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968108:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968115:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968122:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968129:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968135:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968141:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968147:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968153:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968159:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968165:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968171:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968177:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968201:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968207:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968213:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968221:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968227:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968233:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968238:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968243:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968249:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968255:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968261:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968268:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968290:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968297:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968302:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968314:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968320:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.968325:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776587.992398:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a5cca40a200:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1789776587.992995:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a5cd9b3c400:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1789776587.993123:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993131:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993136:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993141:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993146:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993152:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993157:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993162:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993167:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993203:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993210:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993215:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993220:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993226:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993231:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993237:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993241:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993246:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993251:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993256:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993261:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993266:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993272:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993290:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993296:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993301:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993306:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993311:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993316:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993322:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993327:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993332:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993337:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993342:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993348:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993353:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993358:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993364:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993369:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993375:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993380:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993385:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993390:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993396:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993400:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993406:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993411:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993415:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993420:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993424:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993430:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993435:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993439:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993444:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993449:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993454:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993459:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993463:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993476:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993481:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993486:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993546:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993553:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.993558:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776587.997634:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a5cca326000:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789776587.997960:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a5cca327c00:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1789776587.998055:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998062:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998068:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998073:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998078:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998083:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998088:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998093:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998098:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998103:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998108:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998113:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998118:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998123:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998128:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998133:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998138:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998143:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998147:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998152:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998157:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998162:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998166:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998171:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998176:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998180:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998186:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998190:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998195:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998214:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998219:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998225:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998230:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998234:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998239:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998245:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998250:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998255:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998260:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998265:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998270:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998275:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998281:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998285:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998289:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998294:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998299:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998304:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998309:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998314:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998319:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998324:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998329:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998334:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998339:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998344:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998349:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998353:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998358:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998362:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998367:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998371:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998376:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776587.998381:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776588.006158:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a5cc75e4400:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1789776588.008694:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a5cc75e5e00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1789776588.009041:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009049:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009055:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009060:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009066:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009071:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009077:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009082:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009087:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009093:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009099:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009104:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009109:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009113:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009118:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009122:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009128:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009132:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009138:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009142:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009147:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009152:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009157:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009161:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009167:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009173:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009178:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009183:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009188:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009193:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009198:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009203:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009208:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009213:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009234:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009240:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009245:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009250:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009255:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009259:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009264:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009269:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009273:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009278:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009283:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009288:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009293:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009297:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009302:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009306:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009312:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009316:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009320:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009324:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009329:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009334:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009338:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009344:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009349:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009354:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009358:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009364:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009370:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776588.009377:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.017744:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a5cc574c800:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1789776588.017967:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a5cc574c400:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1789776588.019564:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a5cc574da00:6531] 2 exiting: rc = 0 00000100:00100000:0.0:1789776588.019789:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019799:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019805:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019811:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019817:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019832:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019838:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019860:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019866:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019880:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019887:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019892:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019898:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019904:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019911:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019916:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019922:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019929:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019934:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019940:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019945:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019951:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019957:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019962:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019968:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019973:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019979:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019985:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019991:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.019997:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020003:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020009:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020014:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020035:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020042:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020047:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020052:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020058:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020064:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020069:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020075:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020081:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020094:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020099:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020104:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020110:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020116:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020121:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020126:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020133:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020138:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020143:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020149:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020155:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020160:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020165:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020180:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020186:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020191:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020197:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020201:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020207:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020212:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776588.020226:0:15401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789776588.027690:0:15401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776588.027707:0:15401:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789776588.027713:0:15401:0:(genops.c:885:class_export_put()) final put ffff8a5cc907e000/MDS_uuid 00000020:00000080:1.0:1789776588.027718:0:15401:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cc907e000/MDS_uuid for MDS 00000020:01000000:1.0:1789776588.027731:0:15401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789776588.028261:0:15401:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789776588.259289:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776589.282761:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776589.858691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776589.858702:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776589.858705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776589.858709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789776589.858713:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776589.858722:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1789776589.858727:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789776589.858734:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a5bc1a61800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776589.858775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff349c00 x1876716449586688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776589.858867:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776589.858871:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789776589.858873:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776589.858877:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 406 00000100:00080000:0.0:1789776589.858879:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789776589.858883:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a5cd93f7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776589.858895:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348e00 x1876716449586944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776589.858958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449587072:0@lo:400:kworker.0 00000400:00000100:0.0:1789776589.859010:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587072 offset 0 length 224: 4 00000100:00100000:3.0:1789776589.859125:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776589.859149:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449586816:0@lo:400:kworker.0 00000400:00000100:3.0:1789776589.859175:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449586816 offset 0 length 224: 4 00000100:00100000:2.0:1789776589.859300:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449586688:0@lo:38:kworker.0 00000400:00000100:2.0:1789776589.859325:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449586688 offset 0 length 520: 4 00000100:00100000:2.0:1789776589.859337:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449586944:0@lo:38:kworker.0 00000400:00000100:2.0:1789776589.859353:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449586944 offset 0 length 520: 4 00010000:00010000:1.0:1789776590.307014:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789776591.311892:0:15602:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789776591.323596:0:15602:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789776591.323651:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776591.323667:0:15602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776591.323674:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776591.323680:0:15602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776591.323698:0:15602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789776591.323703:0:15602:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789776591.323740:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776591.323752:0:15602:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff349c00 x1876716449586688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776591.323778:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789776591.323785:0:15602:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789776591.323792:0:15602:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a61800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789776591.323796:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776591.323800:0:15602:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff349c00 x1876716449586688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776604 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776591.323808:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789776591.323811:0:15602:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1789776591.323897:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449586688:0@lo:38:kworker.0 00010000:00010000:2.0:1789776591.324586:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776591.324596:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776591.324606:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf0600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776591.324610:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776591.324621:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776591.324628:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776591.324633:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776591.324636:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789776591.324638:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789776591.324653:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776591.324657:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776591.324664:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf0600/0xf13b8042cb8849d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776591.324693:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776591.324696:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776591.324697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776591.325335:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789776591.325348:0:15602:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff34bb80 x1876716449586816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776591.325376:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789776591.325382:0:15602:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789776591.325403:0:15602:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a67800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789776591.325801:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449586816:0@lo:400:kworker.0 00000100:00100000:1.0:1789776591.325840:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449587200:0@lo:39:umount.0 00000400:00000100:1.0:1789776591.325889:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587200 offset 0 length 224: 4 00010000:00010000:1.0:1789776591.331146:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776591.907674:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789776591.907684:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776591.907686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789776591.907690:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789776591.908195:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449587328:0@lo:400:kworker.0 00000400:00000100:0.0:1789776591.908278:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587328 offset 0 length 224: 4 00010000:00010000:1.0:1789776592.355012:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776593.378982:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789776593.959325:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789776593.959337:0:9510:0:(genops.c:885:class_export_put()) final put ffff8a5bc252b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789776593.960569:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc252b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789776593.960641:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc252c000 for lustre-OST0001 00000001:00100000:2.0:1789776593.969220:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789776593.969238:0:8427:0:(genops.c:885:class_export_put()) final put ffff8a5cd0fc4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789776593.969371:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cd0fc4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789776593.969607:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cf5cec000 for lustre-OST0000 00010000:00010000:1.0:1789776594.403992:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789776594.914710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789776594.914721:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776594.914725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789776594.914728:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789776594.914864:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776594.914888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449587456:0@lo:400:kworker.0 00000400:00000100:2.0:1789776594.914968:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587456 offset 0 length 224: 4 00010000:00010000:1.0:1789776595.427084:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776596.452135:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776597.475023:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776587/real 1789776587] req@ffff8a5cff348700 x1876716449586560/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789776597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776597.475055:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff348700 x1876716449586560/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789776597 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776597.475074:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776597.475095:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789776597.475100:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449586560:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789776597.475166:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776597.475171:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789776597.475174:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776597.475179:0:38:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1789776597.475200:0:38:0:(import.c:589:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789776597.475206:0:38:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff8a5cc8c83000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776597.475245:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff34b800 x1876716449587584/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1789776597.475250:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776597.475269:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776597.475273:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789776597.475293:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449587584:0@lo:250:kworker.0 00000400:00000100:1.0:1789776597.475338:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876716449587584 offset 0 length 520: 4 00000100:00100000:3.0:1789776597.475486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449587712:0@lo:400:kworker.0 00000400:00000100:3.0:1789776597.475540:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587712 offset 0 length 224: 4 00010000:00010000:1.0:1789776598.499634:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776599.523174:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776600.546796:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776601.570715:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776591/real 1789776591] req@ffff8a5cff34a680 x1876716449587200/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789776601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776601.570749:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff34a680 x1876716449587200/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789776601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776601.570769:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a67800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1789776601.571679:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776601.576311:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789776601.576328:0:15602:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff34a680 x1876716449587200/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789776601 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776601.576344:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789776601.576349:0:15602:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789776601.576446:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449587200:0@lo:39:umount.0 00010000:00010000:0.0:1789776601.577960:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.577977:0:15602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.577985:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.577992:0:15602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.578025:0:15602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776601.578032:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.578058:0:15602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578060:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776601.578070:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578071:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.578077:0:15602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.578110:0:15602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789776601.578116:0:15602:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789776601.578147:0:15602:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789776601.578151:0:15602:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789776601.578156:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776601.578163:0:15602:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789776601.578168:0:15602:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a5cfc0d19b8) has no exports 00000020:00080000:0.0:1789776601.578192:0:15602:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a5cfc0d19b8) has no exports 00010000:00010000:2.0:1789776601.578405:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc3bf1400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776601.578411:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578421:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776601.578428:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776601.578433:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776601.578435:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789776601.578438:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789776601.578829:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776601.578834:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578841:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc3bf1400/0xf13b8042cb8849e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578857:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776601.578861:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578868:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776601.578871:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578877:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776601.578894:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776601.578899:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789776601.578901:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789776601.578903:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789776601.578910:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776601.578913:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578918:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2400/0xf13b8042cb884c58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb884c5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.578927:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776601.578929:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776601.578931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776601.578983:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789776601.583209:0:15602:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cff3831e0 - data ffff8a5cf8a3ea20/ffff8a5bc34e1400 00000020:01000000:0.0:1789776601.583376:0:15602:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cc390eba0 - data ffff8a5cf8984948/ffff8a5cfc301800 00100000:10000000:0.0:1789776601.596731:0:15602:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789776601.608081:0:15602:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884734 00000020:00000080:0.0:1789776601.608092:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5bc1a65800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789776601.608114:0:15602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5cfc247800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789776601.608118:0:15602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cfc247800 2 00000020:01000004:0.0:1789776601.608121:0:15602:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a5cfc247800 from lustre-OST0000 00000020:00000080:0.0:1789776601.608142:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776601.608151:0:15602:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789776601.608153:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5bc1a62000/lustre-OST0000_UUID 00000020:00000080:0.0:1789776601.608156:0:15602:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc1a62000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789776601.608169:0:15602:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1789776601.608194:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc1a65800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789776601.609161:0:15602:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789776601.609167:0:15602:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789776601.609172:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776601.609179:0:15602:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789776601.609185:0:15602:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a5bc1a64800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776601.609192:0:15602:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8a5cfc0d3370) has exports, disconnecting them 00000020:00080000:2.0:1789776601.609197:0:15602:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a5bc1a64800), last request at 1789776383 00000020:00000080:2.0:1789776601.609201:0:15602:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88475e 00000020:00080000:2.0:1789776601.609213:0:15602:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5bc1a64800): rc 0 00000020:00000080:2.0:1789776601.609218:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5bc1a64800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789776601.610119:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc1a64800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789776601.610359:0:15602:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789776601.610365:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776601.610369:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789776601.610376:0:15602:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789776601.610551:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776601.610558:0:15602:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789776601.610577:0:15602:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789776601.610582:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776601.610585:0:15602:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789776601.610591:0:15602:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a5bc23f9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789776601.610608:0:15602:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8a5bc2268000) has exports, disconnecting them 00000020:00080000:3.0:1789776601.610612:0:15602:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a5bc23f9000), last request at 1789776383 00000020:00000080:3.0:1789776601.610615:0:15602:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88476c 00000020:00080000:3.0:1789776601.610629:0:15602:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5bc23f9000): rc 0 00000020:00000080:3.0:1789776601.610634:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5bc23f9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789776601.611432:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc1a61800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789776601.611441:0:38:0:(genops.c:885:class_export_put()) final put ffff8a5bc1a66800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789776601.611444:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc1a66800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789776601.611450:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789776601.611521:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc23f9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789776601.613620:0:15602:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789776601.613635:0:15602:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789776601.613639:0:15602:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789776601.613646:0:15602:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776601.613686:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc1a67800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789776601.613879:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776601.613888:0:15602:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789776601.613893:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5bc1a63800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789776601.613896:0:15602:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc1a63800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789776601.613902:0:15602:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789776601.613974:0:15602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5cfc247800 1 00000020:00000080:0.0:1789776601.613979:0:15602:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8846fc 00000020:00000080:0.0:1789776601.613985:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5cfc2e8800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789776601.613993:0:15602:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789776601.614000:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc2e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789776601.614009:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776601.614014:0:15602:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789776601.614018:0:15602:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8a5cfc0d0000) has no exports 00000020:00000080:0.0:1789776601.732330:0:15602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776601.732346:0:15602:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789776601.732352:0:15602:0:(genops.c:885:class_export_put()) final put ffff8a5cfc242800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789776601.732357:0:15602:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc242800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789776601.732377:0:15602:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789776601.732490:0:15602:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a5cfc240800 00000020:02000400:0.0:1789776601.732555:0:15602:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789776602.594857:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776602.659621:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776602.659631:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776602.659634:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789776602.659637:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789776602.659704:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449587840:0@lo:400:kworker.0 00000400:00000100:0.0:1789776602.659764:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587840 offset 0 length 224: 4 00010000:00010000:2.0:1789776603.618736:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776604.642779:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776589/real 1789776589] req@ffff8a5cff348e00 x1876716449586944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789776604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776604.642822:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff348e00 x1876716449586944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789776604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789776604.642842:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776604.642865:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789776604.642869:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449586944:0@lo:38:kworker.0 00000100:00080000:3.0:1789776604.643224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789776604.643231:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776604.643233:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789776604.643236:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789776604.643239:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776604.643244:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1789776604.643249:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789776604.643255:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a5cd93f7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776604.643288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49b100 x1876716449587968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776604.643390:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449588096:0@lo:400:kworker.0 00000400:00000100:3.0:1789776604.643437:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449588096 offset 0 length 224: 4 00010000:00010000:3.0:1789776604.643542:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776604.643710:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449587968:0@lo:38:kworker.0 00000400:00000100:2.0:1789776604.643735:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449587968 offset 0 length 520: 4 00000020:01000004:2.0:1789776605.610161:0:15804:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789776605.626059:0:15804:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789776605.626253:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.626269:0:15804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.626276:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.626282:0:15804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.626311:0:15804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776605.626316:0:15804:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789776605.626343:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776605.626355:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff49b100 x1876716449587968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776605.626440:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789776605.626447:0:15804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789776605.626453:0:15804:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789776605.626458:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776605.626462:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff49b100 x1876716449587968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776624 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789776605.626535:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776605.626544:0:7925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776605.626552:0:7925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776605.626555:0:7925:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776605.626563:0:7925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776605.626572:0:7925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776605.626578:0:7925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776605.626581:0:7925:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789776605.626583:0:7925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789776605.626598:0:7925:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:0.0:1789776605.626617:0:7925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776605.626623:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256000/0xf13b8042cb8849b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776605.626635:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776605.626637:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776605.626638:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776605.640886:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789776605.647287:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449587968:0@lo:38:kworker.0 00000100:00100000:2.0:1789776605.652770:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789776605.654344:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789776605.654362:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff34aa00 x1876716449587072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654399:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff499500 x1876716449587328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654420:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff35d880 x1876716449587456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654442:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff349880 x1876716449587712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654450:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff349500 x1876716449587840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654457:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff49b480 x1876716449588096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776605.654464:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789776605.654469:0:15804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789776605.654531:0:15804:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2529000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789776605.654568:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449588224:0@lo:39:umount.0 00000400:00000100:0.0:1789776605.654622:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716449588224 offset 0 length 224: 4 00000100:00100000:1.0:1789776605.654877:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449587840:0@lo:400:kworker.0 00000100:00100000:1.0:1789776605.654885:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449587072:0@lo:400:kworker.0 00000100:00100000:1.0:1789776605.654931:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449587712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776605.654938:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449587456:0@lo:400:kworker.0 00000100:00100000:2.0:1789776605.655337:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449588096:0@lo:400:kworker.0 00000100:00100000:2.0:1789776605.655345:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449587328:0@lo:400:kworker.0 00010000:00010000:2.0:1789776605.666893:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776606.690827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776607.715072:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776608.739283:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776609.762771:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776609.826702:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789776609.826713:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789776610.786858:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776611.810870:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776612.834707:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776612.838666:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776597/real 1789776597] req@ffff8a5cff34b800 x1876716449587584/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789776612 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776612.838712:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff34b800 x1876716449587584/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789776612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776612.838741:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776612.838771:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789776612.838775:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449587584:0@lo:250:kworker.0 00000100:00080000:1.0:1789776612.838873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789776612.838878:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789776612.838881:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776612.838886:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1789776612.838891:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789776612.838897:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff8a5cc8c83000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776612.838929:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff35d880 x1876716449588352/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776612.839168:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449588352:0@lo:250:kworker.0 00000400:00000100:2.0:1789776612.839217:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876716449588352 offset 0 length 520: 4 00010000:00010000:0.0:1789776613.858814:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776614.895468:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776615.906613:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776605/real 1789776605] req@ffff8a5cff349180 x1876716449588224/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789776615 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789776615.906629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776615.906644:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff349180 x1876716449588224/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789776615 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776615.906664:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2529000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789776615.906686:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449588224:0@lo:39:umount.0 00000100:00080000:1.0:1789776615.906766:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789776615.906771:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789776615.906776:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789776615.908665:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908696:0:15804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908703:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908709:0:15804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908740:0:15804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776615.908747:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908755:0:15804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908761:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908767:0:15804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776615.908787:0:15804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789776615.908793:0:15804:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789776615.908823:0:15804:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789776615.908828:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789776615.908833:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776615.908838:0:15804:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789776615.908842:0:15804:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a5bc2738000) has no exports 00010000:00010000:2.0:1789776615.909454:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776615.909462:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909471:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1e00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776615.909474:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909530:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776615.909539:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776615.909544:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776615.909547:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789776615.909549:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789776615.909564:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776615.909568:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909574:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1e00/0xf13b8042cb8849c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8849cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909591:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776615.909597:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909603:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ce00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776615.909608:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909615:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776615.909621:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776615.909634:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789776615.909636:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789776615.909638:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789776615.909645:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776615.909648:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909654:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc342ce00/0xf13b8042cb884c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb884c51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.909665:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776615.909666:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776615.909668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776615.909756:0:7925:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789776615.911995:0:15804:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a5bc2738000) has no exports 00000020:01000000:1.0:1789776615.915003:0:15804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5ccfa5cde0 - data ffff8a5bc1c16870/ffff8a5cf5e0ec00 00000020:01000000:1.0:1789776615.915314:0:15804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a5cff383a80 - data ffff8a5cf8ab9d80/ffff8a5bc34e2000 00100000:10000000:1.0:1789776615.928414:0:15804:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789776615.957490:0:15804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb88485a 00000020:00000080:2.0:1789776615.957534:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d7000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789776615.957557:0:15804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc1a65000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789776615.957561:0:15804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc1a65000 2 00000020:01000004:2.0:1789776615.957564:0:15804:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a5bc1a65000 from lustre-OST0001 00000020:00000080:2.0:1789776615.957588:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776615.957599:0:15804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789776615.957602:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d5800/lustre-OST0001_UUID 00000020:00000080:2.0:1789776615.957605:0:15804:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789776615.957616:0:15804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789776615.957743:0:15804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72->MGS 00010000:00010000:2.0:1789776615.957759:0:15804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f600/0xf13b8042cb8845b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776615.957786:0:15804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f600/0xf13b8042cb8845b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776615.957808:0:15804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789776615.957811:0:15804:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789776615.957814:0:15804:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789776615.957835:0:15804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776615.957839:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5d0217f600/0xf13b8042cb8845b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb8845ba expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776615.957857:0:15804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776615.957864:0:15804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776615.957869:0:15804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776615.957872:0:15804:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789776615.957873:0:15804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789776615.957882:0:15804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a5cc8c83000 00010000:00010000:2.0:1789776615.957885:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256c00/0xf13b8042cb884a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf13b8042cb884a2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789776615.957901:0:15804:0:(import.c:65:import_set_state_nolock()) ffff8a5cc8c83000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789776615.957906:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789776615.957909:0:15804:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789776615.957910:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789776615.957914:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789776615.957924:0:15804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a5cff35d880 x1876716449588352/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789776632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789776615.957944:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789776615.957947:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:3.0:1789776615.958737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789776615.959412:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72:3642:1876716449588352:0@lo:250:kworker.0 10000000:01000000:2.0:1789776615.959598:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789776615.959624:0:15804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb8844b0 00000020:00000080:2.0:1789776615.959632:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5cc9078000/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 00000020:01000000:2.0:1789776615.959640:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.127@tcp (flags='') 00000020:00000080:2.0:1789776615.959646:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776615.959653:0:15804:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789776615.959657:0:15804:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a5cc8c63370) has no exports 10000000:01000000:2.0:1789776615.959678:0:6514:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789776615.959743:0:15804:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.127@tcp: client import never connected 00000100:00080000:2.0:1789776615.959747:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789776615.959750:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789776615.959753:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789776615.959755:0:15804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789776615.959795:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776615.959801:0:15804:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.127@tcp (uuid fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72) 00000020:01000000:2.0:1789776615.959807:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789776615.959809:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776615.959813:0:15804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789776615.959817:0:15804:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a5bc2136800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776615.959822:0:15804:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8a5bc27399b8) has exports, disconnecting them 00000020:00080000:2.0:1789776615.959827:0:15804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a5bc2136800), last request at 1789776401 00000020:00000080:2.0:1789776615.959831:0:15804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884884 00000020:00080000:2.0:1789776615.959842:0:15804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5bc2136800): rc 0 00000020:00000080:2.0:1789776615.959845:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc2136800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789776615.960413:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cc9078000/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 for MGC192.168.204.127@tcp 00000020:00000080:3.0:1789776615.960424:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cc8c83000 for MGC192.168.204.127@tcp 00000020:00000080:3.0:1789776615.960440:0:37:0:(genops.c:885:class_export_put()) final put ffff8a5cc8c81800/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 00000020:00000080:3.0:1789776615.960442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cc8c81800/fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72 for MGC192.168.204.127@tcp 00000020:01000000:3.0:1789776615.960446:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.127@tcp (fdbe713c-2c1d-4f7b-bb7e-c67fa861cb72) 00000020:00000080:3.0:1789776615.960722:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc2136800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789776615.965724:0:15804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789776615.965734:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776615.965739:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789776615.965746:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789776615.965943:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776615.965954:0:15804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789776615.965961:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789776615.965968:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776615.965972:0:15804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789776615.965980:0:15804:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a5bc252f000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789776615.965987:0:15804:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8a5cff3b0000) has exports, disconnecting them 00000020:00080000:3.0:1789776615.965991:0:15804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a5bc252f000), last request at 1789776401 00000020:00000080:3.0:1789776615.965995:0:15804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884899 00000020:00000080:1.0:1789776615.966310:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5cd93f7800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789776615.966330:0:37:0:(genops.c:885:class_export_put()) final put ffff8a5bc24d3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789776615.966334:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc24d3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789776615.966345:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00080000:3.0:1789776615.966610:0:15804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a5bc252f000): rc 0 00000020:00000080:3.0:1789776615.966616:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc252f000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789776615.967296:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc252f000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789776616.055576:0:15804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789776616.055586:0:15804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789776616.055590:0:15804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789776616.055598:0:15804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789776616.055636:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a5bc2529000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789776616.057946:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789776616.100679:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789776616.127606:0:7925:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789776616.127946:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a5cd0a18800:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1789776616.128228:0:13726:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8a5bc2716600:13726] 2 exiting: rc = 0 00000100:00100000:2.0:1789776616.128325:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a5cd0a19a00:6499] 0 exiting: rc = 1 00000100:00100000:1.0:1789776616.129037:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.138682:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a5cd8529000:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1789776616.146949:0:7458:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a5cf0fa9600:7458] 3 exiting: rc = 0 00000100:00100000:2.0:1789776616.147097:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a5cc6125a00:6503] 2 exiting: rc = 0 00000100:00100000:1.0:1789776616.148126:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a5cd0a19200:6502] 1 exiting: rc = 0 00000100:00100000:3.0:1789776616.148333:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148342:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148348:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148354:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148360:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148365:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148381:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148388:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148408:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148413:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148419:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148425:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148430:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148437:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148444:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148459:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148465:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148472:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148478:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148484:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148490:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148521:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148526:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148531:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148535:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148540:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148546:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148551:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148555:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148560:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148566:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148571:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148577:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148581:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148586:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148591:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148596:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148601:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148606:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148611:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148615:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148621:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148625:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148638:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148644:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148648:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148653:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148659:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148664:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148669:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148674:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148679:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148683:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148688:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148692:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148697:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148703:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148708:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148713:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148718:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148723:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148728:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148733:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.148739:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789776616.150133:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776616.150144:0:15804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789776616.150150:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc252b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789776616.150154:0:15804:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc252b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789776616.150162:0:15804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789776616.150212:0:15804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc1a65000 1 00000020:00000080:3.0:1789776616.150218:0:15804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf13b8042cb884829 00000020:00000080:3.0:1789776616.150224:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc2133000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789776616.150243:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789776616.150248:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776616.150252:0:15804:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789776616.150256:0:15804:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8a5bc22699b8) has no exports 00000020:00000080:1.0:1789776616.154515:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc2133000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789776616.189765:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776616.189791:0:15804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789776616.189797:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5bc23fc000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789776616.189802:0:15804:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5bc23fc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789776616.189808:0:15804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789776616.190252:0:15804:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a5bc1a62800 00000020:01000000:2.0:1789776616.190275:0:15804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789776616.190296:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776616.190301:0:15804:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776616.190305:0:15804:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a5cf5dd3370) has no exports 00000020:00000080:2.0:1789776616.190325:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776616.190330:0:15804:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789776616.190333:0:15804:0:(genops.c:885:class_export_put()) final put ffff8a5cfc2e8000/OSS_uuid 00000020:00000080:2.0:1789776616.190336:0:15804:0:(genops.c:844:class_export_destroy()) destroying export ffff8a5cfc2e8000/OSS_uuid for OSS 00000020:01000000:2.0:1789776616.190340:0:15804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789776616.191439:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789776616.191943:0:8528:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a5bc10fec00:8528] 3 exiting: rc = 0 00000100:00100000:1.0:1789776616.192012:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a5cfc20ea00:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1789776616.192128:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a5cf513ac00:8434] 2 exiting: rc = 0 00000100:00100000:2.0:1789776616.192585:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a5cfc212a00:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1789776616.192898:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192908:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192915:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192922:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192927:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192932:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192937:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192942:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192947:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192951:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192956:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192961:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192966:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192971:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192976:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192981:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192987:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192992:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.192997:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193001:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193005:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193010:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193016:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193020:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193024:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193028:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193033:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193037:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193041:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193045:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193049:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193053:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193058:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193063:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193067:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193084:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193089:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193093:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193098:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193102:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193106:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193111:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193115:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193120:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193126:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193131:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193135:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193140:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193145:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193157:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193164:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193169:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193173:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193179:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193189:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193196:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193200:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193205:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193211:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193216:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193220:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193225:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193230:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.193240:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.195341:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a5cfc20e400:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1789776616.197585:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a5cfc2cfe00:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1789776616.200170:0:9975:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a5bc1a5c000:9975] 2 exiting: rc = 0 00000100:00100000:3.0:1789776616.200361:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.200974:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.200986:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.200992:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.200997:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201002:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201020:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201026:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201031:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201036:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201041:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201046:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201051:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201056:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201061:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201072:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201079:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201085:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201090:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201096:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201101:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201106:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201111:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201118:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201123:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201128:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201133:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201137:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201142:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201147:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201152:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201157:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201161:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201167:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201172:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201177:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201183:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201187:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201192:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201197:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201201:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201213:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201218:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201223:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201227:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201232:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201237:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201242:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201247:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201252:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201257:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201262:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201267:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201272:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201291:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201298:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201303:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201307:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201312:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201316:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201321:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201326:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201331:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.201336:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776616.210715:0:14615:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8a5bc3dace00:14615] 3 exiting: rc = 0 00000100:00100000:0.0:1789776616.210911:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a5cf0cdc200:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1789776616.211074:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a5cc75e5400:8439] 2 exiting: rc = 0 00000100:00100000:3.0:1789776616.219732:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a5cf0cdc600:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1789776616.224315:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224326:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224341:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224348:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224354:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224360:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.224366:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231653:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231670:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231675:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231681:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231719:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231725:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231731:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231736:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231741:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231747:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231753:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231758:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231762:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231768:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231773:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231778:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231784:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231789:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231795:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231801:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231808:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231814:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231819:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231825:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231831:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231836:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231842:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231848:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231868:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231875:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231880:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231886:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231892:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231899:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231905:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231910:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231917:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231922:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231927:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231940:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231947:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231952:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231957:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231964:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231969:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231974:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231979:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.231992:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232004:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232029:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232035:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232040:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232046:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232053:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232060:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232067:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.232075:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.254188:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a5ceeffd600:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1789776616.254336:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a5ceeffc000:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1789776616.258684:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258693:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258698:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258703:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258708:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258713:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258717:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258722:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258728:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258732:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258737:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258741:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258745:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258751:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258756:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258761:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258765:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258792:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258797:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258802:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258807:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258813:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258817:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258823:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258827:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258831:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258836:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258841:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258845:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258851:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258855:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258860:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258865:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258870:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258877:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258882:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258887:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258892:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258897:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258904:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258910:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258915:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258921:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258927:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258933:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258938:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258946:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258953:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258958:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258963:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258968:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258974:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258988:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258994:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.258999:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259004:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259876:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259882:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259887:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259892:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259899:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259907:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259913:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776616.259919:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776616.264214:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a5cf5c38200:8442] 0 exiting: rc = 1 00000100:00100000:0.0:1789776616.265973:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a5cf5c39400:8443] 1 exiting: rc = 0 00000100:00100000:2.0:1789776616.266205:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266216:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266224:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266230:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266236:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266243:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266249:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266254:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266262:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266293:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266301:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266307:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266314:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266321:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266340:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266350:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266359:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266366:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266372:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266378:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266385:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266407:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266415:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266422:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266428:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266436:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266443:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266450:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266456:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266464:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266471:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266477:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266483:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266545:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266554:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266560:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266574:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266582:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266587:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266593:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266599:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266605:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266611:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266617:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266623:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266645:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266653:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266660:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266667:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266684:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266690:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266696:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266702:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266708:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266713:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266719:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266725:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266746:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266753:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266760:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266767:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266774:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266780:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776616.266794:0:15804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789776616.286612:0:15804:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789776638.164359:0:16569:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789776650.156077:0:17169:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789776650.156084:0:17169:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789776650.156086:0:17169:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789776650.156203:0:17169:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5bc3db5000 00000020:01000004:1.0:1789776650.156219:0:17169:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789776650.156226:0:17169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789776650.156248:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a5bc27399b8) 00000020:00000080:1.0:1789776650.156264:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789776650.213136:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789776650.214077:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.215125:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.215569:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.215816:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.216058:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.216285:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.216513:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.216746:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.217028:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.217236:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.217468:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.217805:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.218052:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789776650.219463:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789776650.222087:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789776650.222351:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.222581:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789776650.222826:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.223094:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789776650.223330:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789776650.223576:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.223807:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.224056:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789776650.224375:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.224810:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.225100:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.225338:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.225573:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.225817:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.226075:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.226338:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.226562:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.226804:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.227059:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.227294:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.227520:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.227760:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.228047:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.228287:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.228639:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.228908:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.229146:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.229377:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.229615:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789776650.229835:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.230316:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789776650.230816:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789776650.231255:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789776650.231479:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789776650.231962:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789776650.232191:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789776650.232430:0:17169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1789776650.233267:0:17169:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789776650.233543:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789776650.233552:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776650.233566:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885a6d 00000020:01000004:3.0:1789776650.233573:0:17169:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789776650.233578:0:17169:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789776650.233583:0:17169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc3db5000 from MGS 00000020:01000004:3.0:1789776650.233587:0:17169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789776650.233597:0:17169:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a5cff3b0000) 00000020:00000080:3.0:1789776650.233606:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789776650.233679:0:17169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3db5000 from MGS, refs=2 00080000:01000000:3.0:1789776650.233686:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789776650.233693:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885a7b 00000100:00100000:3.0:1789776650.233797:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789776650.233955:0:17169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789776650.233961:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789776650.234568:0:17169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789776650.234576:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789776650.235277:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776650.235459:0:17169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789776650.235465:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789776650.236295:0:17169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789776650.236302:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789776650.236918:0:17169:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789776650.236925:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789776650.238948:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.238954:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.238956:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.239375:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.239378:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.239380:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776650.240367:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789776650.243864:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789776650.246124:0:17169:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789776650.247111:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789776650.247170:0:17169:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789776650.247210:0:17169:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789776650.248016:0:17169:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789776650.248314:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776650.248892:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789776650.248900:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789776650.256880:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789776650.258455:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789776650.259160:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789776650.259168:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789776650.260147:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789776650.260171:0:17169:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:1.0:1789776650.260173:0:17169:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789776650.260204:0:17169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:1.0:1789776650.260217:0:17169:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (ffff8a5bc273b370) 00000020:00000080:1.0:1789776650.260235:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789776650.260318:0:17169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc3db7800@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1789776650.260489:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:1.0:1789776650.260527:0:17169:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789776650.268864:0:17186:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789776650.269245:0:17188:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789776650.269342:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 086c90d1-9383-41b8-afea-b47b6abf291d) 00000020:00000080:3.0:1789776650.269368:0:17169:0:(genops.c:1385:class_connect()) connect: client 086c90d1-9383-41b8-afea-b47b6abf291d, cookie 0xf13b8042cb885a89 00000100:00080000:3.0:1789776650.269379:0:17169:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776650.269385:0:17169:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff8a5bc3db7800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776650.269419:0:17169:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff498000 x1876716449588480/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776650.269483:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:086c90d1-9383-41b8-afea-b47b6abf291d:3642:1876716449588480:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789776650.269602:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.269819:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449588480 00000100:00100000:2.0:1789776650.269828:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449588480 00000100:00100000:2.0:1789776650.269863:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776650.269872:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876716449588480:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789776650.269908:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 086c90d1-9383-41b8-afea-b47b6abf291d@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1789776650.269935:0:17182:0:(genops.c:1385:class_connect()) connect: client 086c90d1-9383-41b8-afea-b47b6abf291d, cookie 0xf13b8042cb885a90 00000100:00080000:2.0:1789776650.270095:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3e0f800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789776650.270778:0:17169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 086c90d1-9383-41b8-afea-b47b6abf291d->MGS 00000020:01000004:3.0:1789776650.270845:0:17169:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789776650.270851:0:17169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789776650.270865:0:17169:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a5cff3b19b8) 00000020:00000080:3.0:1789776650.270878:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789776650.274576:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+5:3642:x1876716449588480:12345-0@lo:250:mount.lustre.0 Request processed in 4691us (4961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.274592:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776650.276922:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789776650.276936:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:1.0:1789776650.276945:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789776650.276951:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789776650.276955:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3db7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789776650.276959:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789776650.276979:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789776650.276987:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:086c90d1-9383-41b8-afea-b47b6abf291d:3642:1876716449588480:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789776650.285473:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776650.286029:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789776650.286036:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789776650.293640:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789776650.293656:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789776650.296590:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776650.296603:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789776650.300209:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776650.300411:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789776650.300418:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789776650.305069:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789776650.305081:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789776650.338480:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776650.339111:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789776650.339118:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789776650.340308:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789776650.340323:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789776650.341141:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776650.341318:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789776650.341323:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789776650.342317:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789776650.342326:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789776650.343121:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776650.343321:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789776650.343327:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789776650.345196:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789776650.345211:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789776650.346254:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776650.346903:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789776650.346915:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789776650.347431:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789776650.347437:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789776650.365906:0:17169:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776650.366370:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789776650.366377:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789776650.373552:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789776650.373568:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789776650.377314:0:17169:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776650.377328:0:17169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789776650.379235:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789776650.379263:0:17169:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789776650.379269:0:17169:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789776650.379370:0:17169:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789776650.379406:0:17169:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789776650.379410:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789776650.379411:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776650.379413:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776650.379414:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776650.379415:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776650.379416:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776650.379418:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776650.379419:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776650.379421:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776650.379422:0:17169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789776650.379424:0:17169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789776650.379426:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776650.379427:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776650.379427:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776650.379428:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776650.379429:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776650.379430:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776650.379431:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776650.379432:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776650.379433:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776650.379434:0:17169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789776650.379458:0:17169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789776650.379477:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789776650.379587:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.379631:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.379925:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449588608 00000100:00100000:3.0:1789776650.379932:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449588608 00000100:00100000:3.0:1789776650.379978:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776650.379988:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+5:17169:x1876716449588608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789776650.380035:0:17185:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789776650.380038:0:17185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789776650.380041:0:17185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789776650.380405:0:17206:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789776650.380986:0:17185:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789776650.385039:0:17207:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789776650.385049:0:17207:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789776650.385053:0:17207:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789776650.385056:0:17207:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789776650.386731:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789776650.387165:0:17185:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789776650.387176:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789776650.391665:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+5:17169:x1876716449588608:12345-0@lo:253:mount.lustre.0 Request processed in 11668us (12068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.391680:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776650.391786:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789776650.391814:0:17169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789776650.391832:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789776650.391834:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776650.391836:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776650.391837:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776650.391839:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776650.391840:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776650.391842:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776650.391843:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776650.391844:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776650.391845:0:17169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789776650.391865:0:17169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc3db5000 from lustre-MDT0000 10000000:01000000:0.0:1789776650.391898:0:17169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789776650.391901:0:17169:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789776650.391905:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a5bc273b370 10000000:01000000:0.0:1789776650.391909:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776650.391917:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a5bc273b370 from 1 10000000:01000000:0.0:1789776650.391920:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789776650.391958:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.391970:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.391978:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776650.391999:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776650.392043:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.392087:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.392173:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449588736 00000100:00100000:2.0:1789776650.392180:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449588736 00000100:00100000:2.0:1789776650.392223:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776650.392234:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+5:17169:x1876716449588736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.392249:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776650.392264:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb885aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885a9e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.392295:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb885aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885a9e expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.392306:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a3400/0xf13b8042cb885aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885a9e expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.392315:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3400, rc 0) 00000100:00100000:2.0:1789776650.392352:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+6:17169:x1876716449588736:12345-0@lo:101:mount.lustre.0 Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.392359:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776650.392380:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776650.392395:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.392414:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776650.392540:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776650.392566:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.392583:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.392664:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449588864 00000100:00100000:3.0:1789776650.392669:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449588864 00000100:00100000:3.0:1789776650.392700:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776650.392707:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+6:17169:x1876716449588864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776650.392796:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+6:17169:x1876716449588864:12345-0@lo:501:mount.lustre.0 Request processed in 89us (228us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776650.392803:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776650.392837:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588864:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789776650.392875:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789776650.392897:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.392905:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776650.392913:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5bc3db5000 10000000:01000000:1.0:1789776650.392917:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789776650.392920:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a5bc3db5000 10000000:01000000:1.0:1789776650.392923:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789776650.392926:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a5bc3db5000 from 1 10000000:01000000:1.0:1789776650.392928:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789776650.392945:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.392951:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.392958:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776650.392979:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776650.393004:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776650.393032:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.393242:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449588992 00000100:00100000:2.0:1789776650.393247:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449588992 00000100:00100000:2.0:1789776650.393282:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776650.393289:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+6:17169:x1876716449588992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.393305:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776650.393317:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb885ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885aac expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.393333:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb885ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885aac expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.393342:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2800/0xf13b8042cb885ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885aac expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.393348:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2800, rc 0) 00000100:00100000:2.0:1789776650.393386:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+7:17169:x1876716449588992:12345-0@lo:101:mount.lustre.0 Request processed in 98us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.393393:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776650.393880:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449588992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776650.393895:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ab3 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.393903:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885ab3 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776650.393914:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789776650.393929:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ab3 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.393936:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1000/0xf13b8042cb885aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ab3 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776650.393943:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789776650.395855:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776650.395868:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a5bc3db5000 10000000:01000000:0.0:1789776650.395872:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789776650.395877:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789776650.395879:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776650.395916:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.395927:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.395937:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776650.395962:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776650.396029:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.396083:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.396341:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449589120 00000100:00100000:3.0:1789776650.396349:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449589120 00000100:00100000:3.0:1789776650.396391:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776650.396401:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+7:17169:x1876716449589120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776650.396415:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776650.396431:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb885ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885aba expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.396467:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb885ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885aba expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.396477:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257200/0xf13b8042cb885ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885aba expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.396485:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257200, rc 0) 00000100:00100000:3.0:1789776650.396566:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+8:17169:x1876716449589120:12345-0@lo:101:mount.lustre.0 Request processed in 165us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.396573:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776650.401326:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.401361:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ac1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.401375:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885ac1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.401462:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776650.401749:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776650.401892:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449589248 00000100:00100000:3.0:1789776650.401898:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449589248 00000100:00100000:3.0:1789776650.401950:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776650.401959:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+8:17169:x1876716449589248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776650.402114:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+9:17169:x1876716449589248:12345-0@lo:501:mount.lustre.0 Request processed in 155us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.402121:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776650.402308:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbe540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.402324:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776650.402379:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776650.402420:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.402452:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbe540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.402950:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449589376 00000100:00100000:3.0:1789776650.402956:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449589376 00000100:00100000:3.0:1789776650.402995:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776650.403003:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+9:17169:x1876716449589376:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776650.403875:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+9:17169:x1876716449589376:12345-0@lo:503:mount.lustre.0 Request processed in 870us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.403884:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776650.404057:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449589376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776650.407967:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17208:1876716449589504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.408063:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.408224:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776650.408284:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449589504 00000100:00100000:1.0:1789776650.408293:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449589504 00000100:00100000:1.0:1789776650.408408:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776650.408419:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+9:17208:x1876716449589504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776650.409972:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+9:17208:x1876716449589504:12345-0@lo:502:llog_process_th.0 Request processed in 1549us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776650.409984:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776650.410246:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17208:1876716449589504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776650.410285:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776650.410297:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776650.410299:0:17208:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789776650.410304:0:17208:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789776650.410306:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776650.410323:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a5bc22699b8) 00000020:00000080:2.0:1789776650.410339:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789776650.410345:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789776650.410444:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789776650.410454:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885acf 00000020:00000080:2.0:1789776650.410910:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789776650.410916:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776650.410920:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776650.410921:0:17208:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789776650.410923:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776650.410926:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776650.410928:0:17208:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789776650.410931:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776650.410941:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a5bc226b370) 00000020:00000080:2.0:1789776650.410953:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789776650.410957:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789776650.410958:0:17208:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789776650.410962:0:17208:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789776650.410969:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789776650.411022:0:17208:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3db5000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789776650.411035:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a5bc226cd28) 00000020:00000080:2.0:1789776650.411042:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789776650.411277:0:17208:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789776650.411284:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885ae4 00000020:00000080:2.0:1789776650.411379:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789776650.411387:0:17208:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789776650.411391:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf13b8042cb885aeb 00080000:01000000:2.0:1789776650.411397:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789776650.411400:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885af2 00010000:00010000:2.0:1789776650.496478:0:17208:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789776650.512193:0:17208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789776650.513932:0:17208:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789776650.515584:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a5cff3b4d28) 00000020:00000080:3.0:1789776650.515607:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789776650.515709:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789776650.515718:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885b00 00000020:00000080:3.0:1789776650.519969:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789776650.528092:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf13b8042cb885b07 00000020:00000080:0.0:1789776650.531323:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789776650.531337:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.531343:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.531345:0:17208:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789776650.531354:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776650.531356:0:17208:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789776650.531358:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.531360:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.531361:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789776650.531363:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.531365:0:17208:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776650.531367:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776650.531371:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.531372:0:17208:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789776650.531377:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789776650.531425:0:17208:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789776650.531440:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.531442:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.531443:0:17208:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789776650.531446:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776650.531448:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.531449:0:17208:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789776650.531452:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776650.531457:0:17208:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:0.0:1789776650.531482:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776650.531581:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a5cf5dd4d28) 00000020:00000080:0.0:1789776650.531599:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789776650.531604:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776650.531682:0:17208:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789776650.531688:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789776650.531695:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885b15 00010000:00080000:0.0:1789776650.531724:0:17208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cd0ed8800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776650.533257:0:17208:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789776650.542715:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776650.542731:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789776650.542773:0:17208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789776650.542808:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885b1c 00000100:00080000:0.0:1789776650.542826:0:17208:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776650.542834:0:17208:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a5cd0ed8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776650.542884:0:17208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348a80 x1876716449589632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776650.542907:0:17208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789776650.542957:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.542960:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.542962:0:17208:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789776650.542965:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776650.542967:0:17208:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789776650.542969:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.542971:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.542972:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789776650.542975:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.542976:0:17208:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776650.542978:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776650.542983:0:17208:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789776650.542985:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.542987:0:17208:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789776650.542989:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776650.542993:0:17208:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1789776650.543015:0:17208:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789776650.543017:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776650.543028:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a5cf5dd0000) 00000020:00000080:0.0:1789776650.543039:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789776650.543043:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776650.543104:0:17208:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789776650.543110:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789776650.543115:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885b2a 00010000:00080000:0.0:1789776650.543142:0:17208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cfaf0e000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776650.543322:0:17208:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789776650.544257:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789776650.544333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776650.545049:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449589632 00000100:00100000:3.0:1789776650.545059:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449589632 00000100:00100000:3.0:1789776650.545105:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776650.545113:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449589632:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789776650.545129:0:17195:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1789776650.547889:0:17208:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789776650.551804:0:17208:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789776650.563959:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776650.568734:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789776650.578189:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789776650.581959:0:17214:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789776650.581968:0:17214:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789776650.582361:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776650.582373:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789776650.582408:0:17208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789776650.582426:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885b31 00000100:00080000:0.0:1789776650.582438:0:17208:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776650.582444:0:17208:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a5cfaf0e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776650.582481:0:17208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff34b480 x1876716449589760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776650.582528:0:17208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789776650.582557:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589760:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789776650.582635:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449589760 offset 0 length 520: 4 00000020:01000000:0.0:1789776650.583956:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.583963:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.583965:0:17208:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789776650.583968:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776650.583971:0:17208:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789776650.583972:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.583974:0:17208:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776650.583975:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789776650.583978:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.583979:0:17208:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776650.583982:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776650.583985:0:17208:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789776650.583989:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.583990:0:17208:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789776650.583993:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776650.583997:0:17208:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1789776650.584029:0:17208:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789776650.584032:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776650.584049:0:17208:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a5cf5dd19b8) 00000020:00000080:0.0:1789776650.584075:0:17208:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789776650.584081:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776650.584163:0:17208:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789776650.584168:0:17208:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789776650.584174:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf13b8042cb885b3f 00010000:00080000:0.0:1789776650.584202:0:17208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cfaf0f800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776650.584415:0:17208:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789776650.584490:0:17208:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789776650.584526:0:17208:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789776650.585661:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449589632:12345-0@lo:38:llog_process_th.0 Request processed in 40534us (41314us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789776650.585678:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789776650.585736:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776650.585742:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776650.585746:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589632:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789776650.588063:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776650.588811:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789776650.588937:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789776650.590583:0:17216:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789776650.590590:0:17216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789776650.591435:0:17208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776650.591448:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789776650.591484:0:17208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789776650.591539:0:17208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885b46 00000100:00080000:0.0:1789776650.591550:0:17208:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776650.591556:0:17208:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776650.591592:0:17208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348000 x1876716449589888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776650.591633:0:17208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789776650.591694:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.591698:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.591700:0:17208:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789776650.591703:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776650.591715:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.591717:0:17208:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789776650.591721:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776650.591722:0:17208:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789776650.591725:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776650.591727:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.591728:0:17208:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789776650.591731:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776650.591733:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776650.591734:0:17208:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789776650.591738:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789776650.591772:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17208:1876716449590016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776650.591861:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.591906:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedd239c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.591912:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590016 00000100:00100000:3.0:1789776650.591920:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590016 00000100:00100000:3.0:1789776650.591972:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776650.591981:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+9:17208:x1876716449590016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776650.592094:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589888:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789776650.592123:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+9:17208:x1876716449590016:12345-0@lo:502:llog_process_th.0 Request processed in 143us (261us total) trans 0 rc 0/0 00000400:00000100:1.0:1789776650.592123:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449589888 offset 0 length 520: 4 00000100:00100000:3.0:1789776650.592130:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776650.592192:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17208:1876716449590016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776650.592215:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776650.592220:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776650.592222:0:17208:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789776650.592226:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789776650.592384:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789776650.592404:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789776650.592432:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ac1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.592443:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdea00/0xf13b8042cb885aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ac1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776650.592452:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc3db5000 from 1 10000000:01000000:3.0:1789776650.592455:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789776650.592481:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.592521:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.592531:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776650.592545:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776650.592574:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776650.592589:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776650.592751:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590144 00000100:00100000:1.0:1789776650.592756:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590144 00000100:00100000:1.0:1789776650.592790:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776650.592797:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+9:17169:x1876716449590144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776650.592807:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776650.592823:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885b4d expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.592846:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.592857:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.592865:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1800, rc 0) 00000100:00100000:1.0:1789776650.592917:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+10:17169:x1876716449590144:12345-0@lo:101:mount.lustre.0 Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776650.592923:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776650.592991:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.593004:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.593013:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.593773:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590272:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789776650.593818:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.593911:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789776650.593955:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590272 00000100:00100000:0.0:1789776650.593961:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590272 00000100:00100000:0.0:1789776650.594030:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776650.594038:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+10:17169:x1876716449590272:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789776650.594055:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789776650.594060:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789776650.594134:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+10:17169:x1876716449590272:12345-0@lo:256:mount.lustre.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776650.594141:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776650.594204:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590272:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789776650.594786:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789776650.594802:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.594870:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776650.594879:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc3db5000 from 1 10000000:01000000:2.0:1789776650.594881:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776650.594908:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.594916:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.594925:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.594941:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776650.594978:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.595278:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776650.595312:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590400 00000100:00100000:1.0:1789776650.595317:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590400 00000100:00100000:1.0:1789776650.595349:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776650.595356:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+10:17169:x1876716449590400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776650.595366:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776650.595378:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885b5b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.595404:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.595414:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776650.595423:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776650.595521:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449590400:12345-0@lo:101:mount.lustre.0 Request processed in 165us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776650.595528:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776650.595858:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.595873:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.595882:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776650.596013:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776650.596044:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776650.596107:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3508000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776650.596144:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590528 00000100:00100000:0.0:1789776650.596150:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590528 00000100:00100000:0.0:1789776650.596211:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776650.596218:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449590528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776650.596365:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449590528:12345-0@lo:501:mount.lustre.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776650.596371:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776650.596435:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776650.596463:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776650.596527:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776650.596805:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.596859:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590656 00000100:00100000:3.0:1789776650.596864:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590656 00000100:00100000:3.0:1789776650.596887:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776650.596894:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449590656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776650.596983:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449590656:12345-0@lo:503:mount.lustre.0 Request processed in 89us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.596990:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776650.597073:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449590656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776650.597485:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17218:1876716449590784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776650.597716:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776650.597742:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.597785:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590784 00000100:00100000:3.0:1789776650.597790:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590784 00000100:00100000:3.0:1789776650.597814:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776650.597819:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17218:x1876716449590784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776650.598256:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17218:x1876716449590784:12345-0@lo:502:llog_process_th.0 Request processed in 435us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.598264:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776650.598359:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17218:1876716449590784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776650.598386:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776650.598397:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.598400:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789776650.598407:0:17218:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc3db5000 00000020:00000080:1.0:1789776650.598409:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776650.598418:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776650.598420:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.598422:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789776650.598424:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776650.598427:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.598428:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789776650.598431:0:17218:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc3db5000 00000020:00000080:1.0:1789776650.598433:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776650.598542:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776650.600968:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.600976:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789776650.600987:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776650.600994:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.600995:0:17218:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776650.601001:0:17218:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc3db5000 00000020:00000080:1.0:1789776650.601003:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776650.601300:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776650.601305:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.601307:0:17218:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776650.601309:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776650.601312:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776650.601313:0:17218:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789776650.601316:0:17218:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc3db5000 00000020:00000080:1.0:1789776650.601318:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776650.603859:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17218:1876716449590912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776650.603953:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776650.603998:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9329c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.607737:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449590912 00000100:00100000:3.0:1789776650.607753:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449590912 00000100:00100000:3.0:1789776650.608874:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776650.608888:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17218:x1876716449590912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776650.609054:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+11:17218:x1876716449590912:12345-0@lo:502:llog_process_th.0 Request processed in 170us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.609062:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776650.609130:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17218:1876716449590912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776650.609166:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776650.609173:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776650.609175:0:17218:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789776650.609179:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789776650.609355:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789776650.609380:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776650.609403:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.609426:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776650.609480:0:17169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789776650.609483:0:17169:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5bc3db5000 10000000:01000000:2.0:1789776650.609485:0:17169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5bc3db5000 10000000:01000000:2.0:1789776650.609489:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776650.609546:0:17169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc3db5000 from 1 10000000:01000000:2.0:1789776650.609549:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776650.609580:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.609588:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.609597:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.609744:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776650.610319:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.610361:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.610413:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591040 00000100:00100000:3.0:1789776650.610419:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591040 00000100:00100000:3.0:1789776650.610463:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776650.610472:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+11:17169:x1876716449591040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776650.610482:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776650.610518:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257e00/0xf13b8042cb885b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885b69 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.610542:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257e00/0xf13b8042cb885b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885b69 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.610552:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc257e00/0xf13b8042cb885b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b69 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.610560:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257e00, rc 0) 00000100:00100000:3.0:1789776650.610596:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591040:12345-0@lo:101:mount.lustre.0 Request processed in 126us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.610687:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776650.610770:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776650.610844:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b70 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.610854:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885b70 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.610916:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776650.610941:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.610960:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.610997:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591168 00000100:00100000:3.0:1789776650.611001:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591168 00000100:00100000:3.0:1789776650.611028:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776650.611034:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776650.611132:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591168:12345-0@lo:501:mount.lustre.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.611139:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776650.611192:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776650.611219:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776650.611249:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.611266:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.611280:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591296 00000100:00100000:2.0:1789776650.611282:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591296 00000100:00100000:2.0:1789776650.611300:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776650.611305:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776650.611368:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591296:12345-0@lo:503:mount.lustre.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.611375:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776650.611407:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776650.612911:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.612975:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.613005:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591424 00000100:00100000:2.0:1789776650.613010:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591424 00000100:00100000:2.0:1789776650.613046:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776650.613054:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.613155:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591424:12345-0@lo:502:llog_process_th.0 Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.613170:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776650.613211:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.613226:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591424:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789776650.613288:0:17222:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789776650.613302:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a5bc2268000) 00000020:00000080:2.0:1789776650.613321:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789776650.613415:0:17222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3db5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789776650.613419:0:17222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc3db5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789776650.613421:0:17222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc3db5000 4 00010000:00080000:2.0:1789776650.613461:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc378e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776650.620401:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789776650.625738:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789776650.625933:0:17222:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776650.625948:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf13b8042cb885b7e 00000100:00080000:2.0:1789776650.625959:0:17222:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776650.625965:0:17222:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a5bc378e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776650.625999:0:17222:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e90700 x1876716449591552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776650.626028:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789776650.626095:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449591552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789776650.626163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.626296:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591552 00000100:00100000:2.0:1789776650.626303:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591552 00000100:00100000:2.0:1789776650.626339:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776650.626347:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449591552:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789776650.626400:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449591552:12345-0@lo:38:llog_process_th.0 Request processed in 52us (236us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789776650.626407:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776650.628793:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776650.628804:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc378e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776650.628811:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789776650.628815:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449591552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789776650.629710:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.630757:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.630885:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc651ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776650.630952:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591680 00000100:00100000:3.0:1789776650.630961:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591680 00000100:00100000:3.0:1789776650.631018:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776650.631029:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776650.631170:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591680:12345-0@lo:502:llog_process_th.0 Request processed in 143us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776650.631178:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776650.631388:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.631437:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.631469:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776650.631489:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591808 00000100:00100000:2.0:1789776650.631518:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591808 00000100:00100000:2.0:1789776650.631540:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776650.631546:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776650.631963:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:17222:x1876716449591808:12345-0@lo:502:llog_process_th.0 Request processed in 415us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.631971:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776650.632003:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc651ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.632014:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:086c90d1-9383-41b8-afea-b47b6abf291d:17222:1876716449591808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789776650.632033:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789776650.632164:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789776650.632187:0:17169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776650.632207:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b70 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776650.632219:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3c00/0xf13b8042cb885b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b70 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776650.632263:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776650.632265:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789776650.632266:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776650.632267:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776650.632271:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776650.632273:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776650.632274:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776650.632275:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789776650.632277:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776650.632278:0:17169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776650.632282:0:17169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789776650.632284:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776650.632285:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789776650.632286:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776650.632287:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776650.632288:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776650.632289:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776650.632290:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776650.632291:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789776650.632292:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776650.632293:0:17169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776650.632306:0:17169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789776650.632315:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776650.632345:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776650.632358:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.632767:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449591936 00000100:00100000:2.0:1789776650.632774:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449591936 00000100:00100000:2.0:1789776650.634798:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776650.634813:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789776650.634846:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789776650.634858:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789776650.638408:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789776650.638431:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789776650.638670:0:17206:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789776650.638676:0:17206:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789776650.638701:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.638720:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.638729:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.638771:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.638796:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776650.638810:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449592064:0@lo:104: 00000100:00100000:0.0:1789776650.638880:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.638929:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776650.639122:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592064 00000100:00100000:2.0:1789776650.639130:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592064 00000100:00100000:2.0:1789776650.639189:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776650.639198:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449592064:12345-0@lo:104: 00010000:00010000:2.0:1789776650.639210:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776650.639266:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776650.639272:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449592064:12345-0@lo:104: Request processed in 76us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.639278:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776650.639315:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449592064:0@lo:104: 00010000:00010000:2.0:1789776650.639333:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776650.639387:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17169:x1876716449591936:12345-0@lo:253:mount.lustre.0 Request processed in 4579us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776650.639395:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789776650.639454:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776650.639460:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639467:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:0.0:1789776650.639470:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639477:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776650.639513:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776650.639519:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776650.639544:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639551:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776650.639568:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639574:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885b4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b54 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639587:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.639589:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776650.639590:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776650.639640:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449592192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776650.639669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776650.639726:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592192 00000100:00100000:0.0:1789776650.639730:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592192 00010000:00010000:0.0:1789776650.639747:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776650.639767:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776650.639773:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+12:3645:x1876716449592192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776650.639794:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776650.639799:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639816:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639830:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1800/0xf13b8042cb885b54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885b4d expref: 12 pid: 17184 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639844:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639852:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776650.639865:0:17175:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001189816s 00010000:00010000:0.0:1789776650.639869:0:17175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639876:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639883:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639889:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639894:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776650.639898:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639904:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639924:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.639933:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776650.639957:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+11:3645:x1876716449592192:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776650.639963:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776650.639986:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449592192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776650.640004:0:17206:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.640011:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776650.640016:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cde400/0xf13b8042cb885b85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776650.642625:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17169:1876716449591936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789776650.642644:0:17169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789776650.642648:0:17169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776650.642649:0:17169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776650.642651:0:17169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776650.642652:0:17169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776650.642654:0:17169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776650.642655:0:17169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776650.642657:0:17169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776650.642658:0:17169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776650.642660:0:17169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776650.642661:0:17169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789776650.642675:0:17169:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1789776650.661861:0:17169:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789776650.662198:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789776650.662424:0:17231:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789776650.662800:0:17231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789776650.663796:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:3.0:1789776650.664276:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789776650.664319:0:17169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789776650.665920:0:17169:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789776650.665938:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789776650.666012:0:17169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776650.667294:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789776650.667362:0:17231:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789776650.668287:0:17169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:0.0:1789776650.669071:0:17232:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a5cff34b100 x1876716449592320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776650.669085:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000040:00080000:3.0:1789776650.669223:0:17169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000020:00080000:2.0:1789776650.669345:0:17230:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789776650.669349:0:17230:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789776650.669404:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789776650.673089:0:17169:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789776650.675408:0:17169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789776650.677735:0:17169:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789776650.677837:0:17169:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaed6c146b988 00100000:10000000:3.0:1789776650.677845:0:17169:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789776650.678960:0:17169:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789776650.678978:0:17169:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789776650.678997:0:17169:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789776650.679018:0:17169:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789776650.682345:0:17169:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776650.682582:0:17169:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789776651.301667:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776651.682697:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000040:00080000:1.0:1789776651.683375:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789776651.938943:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789776651.938959:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc3db5000 from 7 10000000:01000000:0.0:1789776651.938964:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776651.939012:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776651.939026:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776651.939039:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776651.939066:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449592448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776651.939143:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776651.939254:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776651.943805:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592448 00000100:00100000:2.0:1789776651.943827:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592448 00000100:00100000:2.0:1789776651.947808:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776651.947823:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+11:17188:x1876716449592448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776651.947840:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776651.947913:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885b8c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776651.947940:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776651.947958:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776651.947967:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2400, rc 0) 00000100:00100000:2.0:1789776651.948042:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:17188:x1876716449592448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (8901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776651.948048:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776651.949064:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449592448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776651.949090:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776651.949102:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776651.951894:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449592576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789776651.951975:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776651.952015:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776651.955106:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592576 00000100:00100000:2.0:1789776651.955130:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592576 00000100:00100000:2.0:1789776651.955200:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776651.955215:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17188:x1876716449592576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789776651.955247:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776651.955265:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776651.955268:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789776651.955433:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17188:x1876716449592576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 222us (3457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776651.955442:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776651.955753:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449592576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789776651.955814:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776651.955824:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776651.955847:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776652.324767:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776652.710734:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789776652.710916:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:1.0:1789776653.346714:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776653.730671:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:2.0:1789776654.372744:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776654.754581:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:0.0:1789776655.395951:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776655.695970:0:17475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789776655.779565:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000100:00080000:3.0:1789776655.910323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789776655.910330:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789776655.910334:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776655.910341:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1789776655.910346:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776655.910352:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a5cd0ed8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776655.910542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776655.910559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449592704:0@lo:400:kworker.0 00000100:00100000:2.0:1789776655.910636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776655.910750:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592704 00000100:00100000:2.0:1789776655.910759:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592704 00000100:00100000:2.0:1789776655.910805:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776655.910814:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:3645:x1876716449592704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776655.910876:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:3645:x1876716449592704:12345-0@lo:400:kworker.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776655.910891:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776655.910940:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449592704:0@lo:400:kworker.0 00000100:00100000:3.0:1789776655.913785:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49bb80 x1876716449592832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776655.913813:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776655.913817:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776655.913827:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776655.913830:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776655.913832:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789776655.913835:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789776655.913838:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5bc378e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776655.913847:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a5bc378e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776655.913874:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49b800 x1876716449592960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776655.913972:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449592832:0@lo:38:kworker.0 00000100:00100000:2.0:1789776655.914232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776655.914300:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592832 00000100:00100000:2.0:1789776655.914307:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592832 00000100:00100000:2.0:1789776655.914339:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776655.914346:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876716449592832:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789776655.914361:0:17196:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789776655.915923:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449592960:0@lo:38:kworker.0 00000100:00100000:0.0:1789776655.915993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776655.916071:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592960 00000100:00100000:3.0:1789776655.916077:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592960 00000100:00100000:3.0:1789776655.916116:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776655.916122:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449592960:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789776655.916182:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1789776655.916219:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf13b8042cb885b9a 00000004:00100000:3.0:1789776655.916235:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776655.917949:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8863000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776655.918042:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876716449592960:12345-0@lo:38:kworker.0 Request processed in 1916us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776655.918053:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789776655.918151:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a5cff49b800 x1876716449592960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776655.918169:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789776655.918177:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789776655.918183:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789776655.918187:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc378e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776655.918192:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876716449592960:0@lo:38:kworker.0 00000100:00100000:2.0:1789776655.927213:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876716449592832:12345-0@lo:38:kworker.0 Request processed in 12856us (12971us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776655.927228:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789776655.927300:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776655.927306:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776655.927311:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449592832:0@lo:38:kworker.0 00010000:00010000:2.0:1789776656.421644:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789776656.536058:0:17527:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776656.536276:0:17527:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789776656.804842:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000020:00000004:2.0:1789776657.398006:0:17577:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776657.398202:0:17577:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789776657.443725:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776657.826777:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:2.0:1789776658.466662:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776658.850715:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:0.0:1789776659.493889:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776659.875212:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000100:00100000:0.0:1789776660.003650:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776650/real 1789776650] req@ffff8a5cff348000 x1876716449589888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776660.003684:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff348000 x1876716449589888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776660 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776660.003694:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776650/real 1789776650] req@ffff8a5cff34b480 x1876716449589760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776660.003703:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff34b480 x1876716449589760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776660 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776660.003721:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789776660.003752:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789776660.003756:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589888:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789776660.003763:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789776660.003768:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789776660.003772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449589760:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789776660.003942:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789776660.003948:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789776660.003951:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776660.003956:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1789776660.003962:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789776660.003986:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a5cd0ed8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776660.004006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49b800 x1876716449593216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776660.004018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776660.004021:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789776660.004022:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776660.004025:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1789776660.004027:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776660.004030:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a5cfaf0e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776660.004040:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff498380 x1876716449593344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776660.004046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776660.004048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789776660.004050:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776660.004052:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1789776660.004054:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776660.004056:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776660.004066:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff499f80 x1876716449593472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776660.004117:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449593600:0@lo:400:kworker.0 00000100:00100000:3.0:1789776660.004187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776660.004238:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776660.004244:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449593088:0@lo:400:kworker.0 00000100:00100000:3.0:1789776660.004275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776660.004317:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593088 00000100:00100000:3.0:1789776660.004324:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593088 00000100:00100000:3.0:1789776660.004368:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776660.004378:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:3644:x1876716449593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776660.004423:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+12:3644:x1876716449593088:12345-0@lo:400:kworker.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776660.004442:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776660.004489:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449593088:0@lo:400:kworker.0 00000100:00100000:0.0:1789776660.004734:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593216:0@lo:38:kworker.0 00000100:00100000:0.0:1789776660.004767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776660.004796:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593344:0@lo:8:kworker.0 00000400:00000100:0.0:1789776660.004818:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449593344 offset 0 length 520: 4 00000100:00100000:0.0:1789776660.004834:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593472:0@lo:8:kworker.0 00000400:00000100:0.0:1789776660.004852:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449593472 offset 0 length 520: 4 00000100:00100000:3.0:1789776660.004911:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593216 00000100:00100000:3.0:1789776660.004916:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593216 00000100:00100000:3.0:1789776660.004944:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776660.004949:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449593216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789776660.004965:0:17195:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789776660.005727:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593600 00000100:00100000:1.0:1789776660.005735:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593600 00000100:00100000:1.0:1789776660.005773:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776660.005781:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449593600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776660.005842:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449593600:12345-0@lo:400:kworker.0 Request processed in 62us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776660.005849:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789776660.005901:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a5cff499180 x1876716449593600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776660.005914:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449593600:0@lo:400:kworker.0 00000100:00100000:2.0:1789776660.038732:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449593216:12345-0@lo:38:kworker.0 Request processed in 33773us (33955us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776660.038748:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789776660.038840:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789776660.038846:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789776660.038849:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593216:0@lo:38:kworker.0 00010000:00010000:2.0:1789776660.522450:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776660.901405:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:0.0:1789776661.538686:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776661.924100:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:2.0:1789776662.563625:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789776662.947335:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776662.947441:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:2.0:1789776663.589913:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789776663.730314:0:17922:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789776663.730318:0:17922:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789776663.730320:0:17922:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789776663.730446:0:17922:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5bc378a000 00000020:01000004:2.0:1789776663.730470:0:17922:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789776663.730481:0:17922:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789776663.730539:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a5cfc0d0000) 00000020:00000080:2.0:1789776663.730558:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789776663.799476:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789776663.799813:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.800332:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.800598:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.800952:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.801142:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.801389:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.801686:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.801878:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.802057:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.802306:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.802603:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.802872:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789776663.803091:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789776663.804439:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.804765:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.804943:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.805642:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.806232:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.806476:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.806808:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.807040:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.807260:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.807514:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.807739:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789776663.807951:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789776663.808175:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.808742:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.808969:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.809245:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.809619:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.809859:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.810092:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.810394:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.810626:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.811245:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.811715:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.811966:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.813660:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.814124:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.815032:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.816063:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789776663.816809:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.817432:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.819743:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789776663.820579:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00080000:01000000:3.0:1789776663.823026:0:17922:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789776663.823395:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789776663.823819:0:17922:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776663.823836:0:17922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885ba8 00000020:01000004:3.0:1789776663.823844:0:17922:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789776663.823865:0:17922:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789776663.823869:0:17922:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789776663.823876:0:17922:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789776663.823905:0:17922:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789776663.823909:0:17922:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789776663.827976:0:17922:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789776663.828019:0:17922:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789776663.828023:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789776663.828025:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776663.828027:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776663.828028:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776663.828029:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776663.828031:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776663.828032:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776663.828034:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776663.828035:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776663.828038:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789776663.828041:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776663.828042:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776663.828043:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776663.828049:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776663.828050:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776663.828051:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776663.828052:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776663.828053:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776663.828053:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776663.828082:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789776663.828103:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776663.828187:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776663.828250:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd90ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.828333:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593728 00000100:00100000:2.0:1789776663.828341:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593728 00000100:00100000:2.0:1789776663.828405:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776663.828416:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17922:x1876716449593728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789776663.828450:0:17184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789776663.828453:0:17184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789776663.828461:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789776663.828858:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17922:x1876716449593728:12345-0@lo:253:mount.lustre.0 Request processed in 443us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.828867:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789776663.828947:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789776663.828957:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789776663.828960:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776663.828961:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776663.828962:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776663.828963:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776663.828964:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776663.828965:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776663.828966:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776663.828967:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776663.828968:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776663.828987:0:17922:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc378a000 from lustre-MDT0001 10000000:01000000:3.0:1789776663.829018:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789776663.829020:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789776663.829028:0:17922:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5bc273b370 local copy 00010000:00010000:3.0:1789776663.829038:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776663.829126:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776663.829156:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776663.829227:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc64deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.832689:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593856 00000100:00100000:2.0:1789776663.832703:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593856 00000100:00100000:2.0:1789776663.832781:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776663.832792:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:17922:x1876716449593856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776663.833094:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+12:17922:x1876716449593856:12345-0@lo:501:mount.lustre.0 Request processed in 303us (3935us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776663.833102:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776663.836090:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789776663.836127:0:17922:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789776663.836191:0:17922:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789776663.836202:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.836231:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.836263:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5bc378a000 10000000:01000000:1.0:1789776663.836268:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789776663.836273:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a5bc273b370 10000000:01000000:1.0:1789776663.836276:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789776663.836280:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a5bc273b370 from 1 10000000:01000000:1.0:1789776663.836282:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789776663.836318:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.836325:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.836335:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.836365:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776663.836419:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.836551:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.836991:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449593984 00000100:00100000:2.0:1789776663.836998:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449593984 00000100:00100000:2.0:1789776663.837083:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776663.837093:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+12:17922:x1876716449593984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776663.837105:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776663.837119:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2200/0xf13b8042cb885bb6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885baf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.837151:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2200/0xf13b8042cb885bb6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885baf expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.837174:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2200/0xf13b8042cb885bb6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885baf expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.837183:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2200, rc 0) 00000100:00100000:2.0:1789776663.837231:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+13:17922:x1876716449593984:12345-0@lo:101:mount.lustre.0 Request processed in 139us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.837237:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776663.837306:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449593984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.837318:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bb6 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.837326:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885bb6 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.837352:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789776663.837381:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bb6 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.837388:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1c00/0xf13b8042cb885baf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bb6 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.837396:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a5bc378a000 10000000:01000000:1.0:1789776663.837400:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789776663.837403:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a5bc378a000 from 1 10000000:01000000:1.0:1789776663.837406:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789776663.837421:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.837427:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.837434:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.837446:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776663.837473:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.837754:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776663.837833:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594112 00000100:00100000:3.0:1789776663.837838:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594112 00000100:00100000:3.0:1789776663.837869:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776663.837875:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+13:17922:x1876716449594112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776663.837883:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776663.837893:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256600/0xf13b8042cb885bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885bbd expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.837909:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256600/0xf13b8042cb885bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885bbd expref: 14 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.837917:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256600/0xf13b8042cb885bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885bbd expref: 14 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.837923:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256600, rc 0) 00000100:00100000:3.0:1789776663.837998:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+14:17922:x1876716449594112:12345-0@lo:101:mount.lustre.0 Request processed in 122us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776663.838005:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776663.838067:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.838078:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bc4 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.838086:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885bc4 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.838103:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789776663.838118:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bc4 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.838126:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0c00/0xf13b8042cb885bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bc4 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.838132:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789776663.838136:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776663.838142:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a5bc378a000 10000000:01000000:1.0:1789776663.838144:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789776663.838147:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789776663.838149:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789776663.838292:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.838300:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.838308:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.838320:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776663.838348:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.838376:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776663.838425:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594240 00000100:00100000:3.0:1789776663.838429:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594240 00000100:00100000:3.0:1789776663.838459:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776663.838465:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+14:17922:x1876716449594240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776663.838473:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776663.838482:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256400/0xf13b8042cb885bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885bcb expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.838598:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256400/0xf13b8042cb885bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885bcb expref: 15 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.838608:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256400/0xf13b8042cb885bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885bcb expref: 15 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776663.838628:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256400, rc 0) 00000100:00100000:3.0:1789776663.838654:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594240:12345-0@lo:101:mount.lustre.0 Request processed in 189us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776663.838660:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776663.838725:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.838736:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bd2 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.838750:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885bd2 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776663.840272:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789776663.841949:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776663.845985:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789776663.846053:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789776663.846071:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789776663.846089:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789776663.846102:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789776663.846117:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789776663.846130:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789776663.846142:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789776663.847033:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789776663.847068:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789776663.847082:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789776663.847093:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789776663.847102:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789776663.847115:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789776663.847128:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789776663.847142:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789776663.847217:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789776663.847236:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789776663.847248:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789776663.847258:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789776663.847269:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789776663.847281:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789776663.847291:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789776663.847318:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789776663.847324:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789776663.847441:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776663.847693:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.847917:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776663.847961:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594368 00000100:00100000:3.0:1789776663.847969:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594368 00000100:00100000:3.0:1789776663.848028:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776663.848039:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776663.848353:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594368:12345-0@lo:501:mount.lustre.0 Request processed in 315us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776663.848369:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789776663.848425:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776663.848457:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776663.848705:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.848760:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776663.848786:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594496 00000100:00100000:0.0:1789776663.848790:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594496 00000100:00100000:0.0:1789776663.848853:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776663.848860:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789776663.849461:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594496:12345-0@lo:503:mount.lustre.0 Request processed in 600us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776663.849468:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789776663.849573:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789776663.849957:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776663.850021:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776663.850062:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776663.852489:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594624 00000100:00100000:1.0:1789776663.852510:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cca7519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.852575:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594624 00000100:00100000:2.0:1789776663.852627:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776663.852637:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776663.853305:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594624:12345-0@lo:502:mount.lustre.0 Request processed in 668us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.853313:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776663.853487:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776663.853743:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789776663.853775:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789776663.853790:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789776663.853805:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789776663.853819:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789776663.853832:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789776663.853846:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789776663.853859:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789776663.853870:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789776663.853889:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789776663.853904:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789776663.853918:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789776663.853933:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789776663.853943:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789776663.853954:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789776663.853977:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789776663.853988:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789776663.853999:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789776663.854012:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789776663.854024:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789776663.854036:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789776663.854048:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789776663.854061:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789776663.854077:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789776663.854090:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789776663.854102:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789776663.854114:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789776663.854126:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789776663.854137:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789776663.854148:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789776663.854657:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789776663.854679:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789776663.854692:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789776663.854703:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789776663.854717:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789776663.854730:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789776663.854742:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789776663.854754:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789776663.854766:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789776663.854780:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789776663.854792:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789776663.854805:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789776663.854819:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789776663.854832:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789776663.854870:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776663.854936:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.854970:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cca7519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776663.855046:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594752 00000100:00100000:0.0:1789776663.855053:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594752 00000100:00100000:0.0:1789776663.855093:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776663.855102:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776663.855227:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449594752:12345-0@lo:502:mount.lustre.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776663.855234:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776663.855437:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449594752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776663.855482:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789776663.855491:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789776663.856265:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.856277:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.856279:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789776663.856283:0:17926:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789776663.856286:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776663.856298:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a5bc273cd28) 00000020:00000080:1.0:1789776663.856316:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789776663.856321:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789776663.856406:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789776663.856412:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885be0 00000020:00000080:1.0:1789776663.856733:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789776663.856738:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.856741:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.856743:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789776663.856746:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.856749:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.856750:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789776663.856754:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776663.856761:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a5bc2738000) 00000020:00000080:1.0:1789776663.856772:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789776663.856776:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789776663.856778:0:17926:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789776663.856781:0:17926:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789776663.856786:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789776663.856837:0:17926:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc378a000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789776663.856857:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a5cefa999b8) 00000020:00000080:1.0:1789776663.856868:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789776663.856927:0:17926:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789776663.856933:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885bf5 00000020:00000080:1.0:1789776663.857024:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789776663.857031:0:17926:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789776663.857036:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf13b8042cb885bfc 00080000:01000000:1.0:1789776663.857042:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789776663.857045:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885c03 00010000:00010000:1.0:1789776663.946902:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789776663.950329:0:17926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1789776663.950949:0:17926:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789776663.955679:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789776663.955694:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776663.955703:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.955705:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789776663.955711:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776663.955717:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.955718:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789776663.955721:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776663.955733:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:0.0:1789776663.955762:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776663.955778:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a5cf5dd3370) 00000020:00000080:0.0:1789776663.955797:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789776663.955802:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776663.955872:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789776663.955879:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789776663.955885:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885c11 00010000:00080000:0.0:1789776663.955919:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc343e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776663.958702:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789776663.962599:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789776663.962617:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789776663.962666:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789776663.962693:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885c18 00000100:00080000:0.0:1789776663.962706:0:17926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776663.962712:0:17926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a5bc343e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776663.962750:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348000 x1876716449594880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776663.962778:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789776663.962837:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776663.962841:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962843:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789776663.962846:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776663.962849:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789776663.962851:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776663.962852:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776663.962853:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789776663.962856:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962857:0:17926:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776663.962860:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776663.962864:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962871:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789776663.962876:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789776663.962908:0:17926:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789776663.962923:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776663.962926:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962927:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789776663.962930:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789776663.962932:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789776663.962933:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776663.962935:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789776663.962937:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789776663.962939:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962940:0:17926:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789776663.962943:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776663.962946:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789776663.962949:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776663.962950:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789776663.962954:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776663.962958:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1789776663.962985:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789776663.962987:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776663.963001:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a5cc8c63370) 00000020:00000080:0.0:1789776663.963014:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789776663.963019:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776663.963074:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789776663.963094:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789776663.963100:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885c26 00010000:00080000:0.0:1789776663.963132:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc3c84000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776663.963341:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1789776663.963980:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449594880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789776663.964068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776663.964250:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789776663.964255:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789776663.964258:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776663.964264:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:3.0:1789776663.964268:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789776663.964273:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a5cd0ed8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776663.964301:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49a680 x1876716449595008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776663.964327:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.964331:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776663.964333:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.964335:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789776663.964390:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449595136:0@lo:400:kworker.0 00000100:00100000:3.0:1789776663.964424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776663.964458:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595136 00000100:00100000:3.0:1789776663.964465:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595136 00000100:00100000:1.0:1789776663.964624:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776663.964635:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449595136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776663.964696:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449595136:12345-0@lo:400:kworker.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776663.964704:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789776663.964742:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a5cff498000 x1876716449595136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776663.964754:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449595136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776663.964777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449595008:0@lo:38:kworker.0 00000100:00100000:1.0:1789776663.964802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.964830:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449594880 00000100:00100000:1.0:1789776663.964833:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449594880 00000100:00100000:1.0:1789776663.964847:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595008 00000100:00100000:1.0:1789776663.964849:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595008 00000100:00100000:1.0:1789776663.964858:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776663.964864:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449594880:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789776663.964884:0:17195:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1789776663.964927:0:17195:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885c2d 00000004:00100000:1.0:1789776663.964942:0:17195:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789776663.964948:0:17195:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1789776663.965921:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789776663.966182:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789776663.969148:0:17195:0:(import.c:65:import_set_state_nolock()) ffff8a5bc23f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776663.969248:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449594880:12345-0@lo:38:llog_process_th.0 Request processed in 4381us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.969260:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776663.969290:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776663.969296:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449595008:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789776663.969338:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449595008:12345-0@lo:38:kworker.0 Request processed in 41us (4535us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789776663.969344:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776663.969473:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776663.969481:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776663.969485:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789776663.969489:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449595008:0@lo:38:kworker.0 00000100:00100000:1.0:1789776663.969542:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776663.969548:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789776663.969557:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789776663.969563:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789776663.969565:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc343e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789776663.969582:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449594880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776663.970035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776663.970050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449595264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776663.970105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776663.970212:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595264 00000100:00100000:2.0:1789776663.970219:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595264 00000100:00100000:2.0:1789776663.970262:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776663.970270:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449595264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776663.970295:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789776663.970333:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876716449595264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.970339:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776663.970435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449595264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776663.970652:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000040:00080000:3.0:1789776663.972300:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776663.972700:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789776663.972851:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1789776663.973272:0:17931:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789776663.973277:0:17931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789776663.974070:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789776663.974137:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789776663.974179:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789776663.974201:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885c34 00000100:00080000:1.0:1789776663.974211:0:17926:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776663.974217:0:17926:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a5bc3c84000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776663.974251:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff35d180 x1876716449595392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776663.974312:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449595392:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789776663.974382:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449595392 offset 0 length 520: 4 00000100:00080000:1.0:1789776663.974445:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789776663.974592:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.974606:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.974608:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789776663.974612:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789776663.974615:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789776663.974617:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789776663.974618:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789776663.974620:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789776663.974623:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.974624:0:17926:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789776663.974627:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789776663.974631:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789776663.974635:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.974637:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789776663.974640:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789776663.974644:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1789776663.974665:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789776663.974668:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776663.974679:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a5cefa9b370) 00000020:00000080:1.0:1789776663.974691:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789776663.974696:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789776663.974754:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789776663.974760:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789776663.974767:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf13b8042cb885c42 00010000:00080000:1.0:1789776663.974794:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cd8514000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1789776663.975002:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789776663.975067:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789776663.975176:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789776663.975375:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.975380:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776663.975383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.975386:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789776663.977362:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776663.977987:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789776663.978131:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789776663.978771:0:17933:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789776663.978776:0:17933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789776663.979275:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789776663.979286:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789776663.979329:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789776663.979693:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885c49 00000100:00080000:1.0:1789776663.979705:0:17926:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776663.979712:0:17926:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776663.979761:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff35c380 x1876716449595520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776663.979823:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449595520:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789776663.979879:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449595520 offset 0 length 520: 4 00000100:00080000:1.0:1789776663.979935:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789776663.979990:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.979994:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.979995:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789776663.979998:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.980002:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.980003:0:17926:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776663.980006:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776663.980008:0:17926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789776663.980010:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.980012:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.980013:0:17926:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789776663.980015:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.980017:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.980018:0:17926:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776663.980021:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789776663.980043:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.980046:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.980047:0:17926:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776663.980050:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1789776663.980216:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.980221:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776663.980223:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776663.980226:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789776663.980275:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789776663.980305:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789776663.980362:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bd2 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.980373:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1400/0xf13b8042cb885bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885bd2 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776663.980382:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc378a000 from 1 10000000:01000000:0.0:1789776663.980384:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776663.980407:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.980413:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.980423:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776663.980450:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776663.980490:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776663.980540:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc74ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.980654:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595648 00000100:00100000:2.0:1789776663.980661:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595648 00000100:00100000:2.0:1789776663.980712:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789776663.980723:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+15:17922:x1876716449595648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776663.980736:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776663.980749:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885c50 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.980774:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.980784:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776663.980793:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2000, rc 0) 00000100:00100000:2.0:1789776663.980835:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+16:17922:x1876716449595648:12345-0@lo:101:mount.lustre.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.980842:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776663.980978:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.980991:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.981000:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.981884:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595776:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789776663.981936:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.982017:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.982215:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595776 00000100:00100000:2.0:1789776663.982222:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595776 00000100:00100000:2.0:1789776663.982295:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789776663.982312:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+16:17922:x1876716449595776:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789776663.982329:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789776663.982345:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789776663.982348:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789776663.982440:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+16:17922:x1876716449595776:12345-0@lo:256:mount.lustre.0 Request processed in 130us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.982446:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789776663.982548:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595776:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789776663.983109:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776663.983122:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.983132:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.983140:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc378a000 from 1 10000000:01000000:1.0:1789776663.983143:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776663.983169:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.983177:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.983185:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.983199:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776663.983229:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.983528:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776663.983783:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449595904 00000100:00100000:0.0:1789776663.983790:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449595904 00000100:00100000:0.0:1789776663.983822:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776663.983830:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+16:17922:x1876716449595904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776663.983841:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776663.983854:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885c5e expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.983878:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.983888:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.983897:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdee00, rc 0) 00000100:00100000:0.0:1789776663.983942:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449595904:12345-0@lo:101:mount.lustre.0 Request processed in 113us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776663.983949:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789776663.984060:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449595904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.984085:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.984094:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776663.984231:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776663.984261:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776663.984289:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.984311:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776663.984397:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596032 00000100:00100000:0.0:1789776663.984401:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596032 00000100:00100000:0.0:1789776663.984457:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776663.984464:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776663.984584:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596032:12345-0@lo:501:mount.lustre.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776663.984598:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789776663.984709:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776663.984734:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776663.984773:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.984939:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedea83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.984983:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596160 00000100:00100000:2.0:1789776663.984988:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596160 00000100:00100000:2.0:1789776663.985010:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776663.985017:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776663.985114:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596160:12345-0@lo:503:mount.lustre.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.985120:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789776663.985187:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596160:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789776663.985598:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776663.985667:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776663.985705:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.985730:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2ee6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.985948:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596288 00000100:00100000:2.0:1789776663.985953:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596288 00000100:00100000:2.0:1789776663.985974:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776663.985981:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776663.986066:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596288:12345-0@lo:502:mount.lustre.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.986072:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776663.986142:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776663.986325:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789776663.986364:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789776663.986382:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789776663.986395:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789776663.986407:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789776663.986434:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789776663.986457:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789776663.986470:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789776663.986482:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789776663.986602:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789776663.986621:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789776663.986644:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776663.986682:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.986707:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776663.986790:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596416 00000100:00100000:2.0:1789776663.986794:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596416 00000100:00100000:2.0:1789776663.986815:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776663.986821:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776663.986898:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596416:12345-0@lo:502:mount.lustre.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776663.986910:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776663.986977:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776663.987016:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789776663.987023:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789776663.987434:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.987443:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987445:0:17935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789776663.987453:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc378a000 00000020:00000080:1.0:1789776663.987456:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776663.987463:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.987466:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987467:0:17935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789776663.987469:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.987471:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987473:0:17935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789776663.987476:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc378a000 00000020:00000080:1.0:1789776663.987477:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776663.987663:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.987667:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987669:0:17935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789776663.987672:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.987675:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987676:0:17935:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776663.987680:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc378a000 00000020:00000080:1.0:1789776663.987688:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776663.987709:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.987711:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987713:0:17935:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789776663.987715:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776663.987718:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987719:0:17935:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789776663.987722:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc378a000 00000020:00000080:1.0:1789776663.987724:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789776663.987744:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776663.987748:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776663.987749:0:17935:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789776663.987752:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789776663.987787:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789776663.987808:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776663.987825:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.987836:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776663.987897:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789776663.987900:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5bc378a000 10000000:01000000:1.0:1789776663.987903:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5bc378a000 10000000:01000000:1.0:1789776663.987906:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776663.987912:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc378a000 from 1 10000000:01000000:1.0:1789776663.987915:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776663.987945:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.987953:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.987973:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776663.987991:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776663.988033:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.988058:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776663.989249:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596544 00000100:00100000:0.0:1789776663.989259:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596544 00000100:00100000:0.0:1789776663.989302:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789776663.989311:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17922:x1876716449596544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776663.989325:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776663.989340:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdf000/0xf13b8042cb885c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885c6c expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.989381:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdf000/0xf13b8042cb885c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885c6c expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.989392:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdf000/0xf13b8042cb885c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c6c expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.989401:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf000, rc 0) 00000100:00100000:0.0:1789776663.989457:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596544:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776663.989464:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776663.990685:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776663.990708:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c73 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776663.990720:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885c73 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776663.992811:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789776663.993656:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776663.993848:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789776663.993890:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789776663.993906:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789776663.993918:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789776663.993928:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789776663.993938:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789776663.993949:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789776663.993960:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789776663.993971:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789776663.993982:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789776663.993993:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789776663.994005:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789776663.994017:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789776663.994029:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789776663.994052:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789776663.994065:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789776663.994092:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789776663.994122:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789776663.994137:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789776663.994149:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789776663.994163:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789776663.994176:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789776663.994188:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789776663.994203:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789776663.994216:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789776663.994229:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789776663.994241:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789776663.994254:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789776663.994272:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789776663.994277:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789776663.994477:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776663.997039:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776663.997818:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776664.006695:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596672 00000100:00100000:3.0:1789776664.006711:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596672 00000100:00100000:3.0:1789776664.006779:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789776664.006789:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776664.006967:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596672:12345-0@lo:501:mount.lustre.0 Request processed in 179us (9934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776664.006975:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789776664.008686:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776664.008747:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776664.008825:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776664.008855:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776664.010132:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596800 00000100:00100000:3.0:1789776664.010143:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596800 00000100:00100000:3.0:1789776664.010202:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776664.010221:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776664.010377:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596800:12345-0@lo:503:mount.lustre.0 Request processed in 158us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776664.010385:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776664.010732:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789776664.017058:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776664.017150:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776664.017230:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776664.017274:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776664.017683:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449596928 00000100:00100000:0.0:1789776664.017691:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449596928 00000100:00100000:0.0:1789776664.017743:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776664.017753:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776664.017864:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449596928:12345-0@lo:502:mount.lustre.0 Request processed in 112us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.017872:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776664.019193:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449596928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776664.019419:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789776664.019461:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789776664.019475:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789776664.019488:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789776664.019724:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789776664.019740:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789776664.019753:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789776664.019764:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789776664.019776:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789776664.019788:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789776664.019800:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789776664.019813:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789776664.019827:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789776664.019839:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789776664.019851:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789776664.019865:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789776664.019885:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789776664.019912:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789776664.021665:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789776664.021696:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789776664.021712:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789776664.021725:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789776664.021738:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789776664.021750:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789776664.021763:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789776664.021776:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789776664.021788:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789776664.021800:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789776664.021812:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789776664.021825:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789776664.021837:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789776664.021862:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789776664.021876:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789776664.021907:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789776664.021923:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789776664.021936:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789776664.021948:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789776664.021966:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789776664.021980:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789776664.021991:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789776664.022004:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789776664.022016:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789776664.022028:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789776664.022040:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789776664.022053:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789776664.022067:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789776664.023669:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789776664.023866:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789776664.023945:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776664.024025:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776664.024070:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776664.025391:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597056 00000100:00100000:0.0:1789776664.025413:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597056 00000100:00100000:0.0:1789776664.025465:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776664.025475:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776664.026896:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597056:12345-0@lo:502:mount.lustre.0 Request processed in 1417us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.026908:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789776664.029986:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776664.030226:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789776664.030254:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789776664.030290:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776664.030369:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776664.030418:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776664.030430:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597184 00000100:00100000:0.0:1789776664.030437:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597184 00000100:00100000:0.0:1789776664.030542:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789776664.030554:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776664.030671:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597184:12345-0@lo:502:mount.lustre.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.030678:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776664.031339:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776664.031405:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789776664.031416:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789776664.035882:0:17940:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789776664.035902:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a5cc8c619b8) 00000020:00000080:0.0:1789776664.035927:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789776664.036028:0:17940:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc378a000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789776664.036032:0:17940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc378a000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789776664.036035:0:17940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc378a000 3 00010000:00080000:0.0:1789776664.036064:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cf0ee1800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776664.042067:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789776664.042415:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789776664.042459:0:17940:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789776664.042473:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf13b8042cb885c81 00000100:00080000:0.0:1789776664.042485:0:17940:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776664.042508:0:17940:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a5cf0ee1800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776664.042549:0:17940:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff349880 x1876716449597312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776664.042582:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789776664.042610:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776664.042614:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776664.042616:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776664.042619:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789776664.043006:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449597312:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789776664.043073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789776664.044273:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1789776664.044324:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789776664.044367:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776664.044383:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c73 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776664.044395:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0800/0xf13b8042cb885c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c73 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776664.044450:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776664.044453:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776664.044454:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776664.044456:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776664.044457:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776664.044459:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776664.044460:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776664.044462:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776664.044464:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776664.044467:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789776664.044470:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776664.044472:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789776664.044473:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776664.044474:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776664.044475:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776664.044476:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776664.044478:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776664.044479:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776664.044484:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776664.044531:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789776664.044550:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776664.044601:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776664.044629:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776664.045140:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597440 00000100:00100000:0.0:1789776664.045148:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597440 00000100:00100000:0.0:1789776664.045191:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776664.045200:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789776664.045225:0:17182:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789776664.045238:0:17182:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789776664.045548:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597312 00000100:00100000:0.0:1789776664.045553:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597312 00000100:00100000:0.0:1789776664.045575:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776664.045581:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449597312:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789776664.045601:0:17190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1789776664.045703:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf13b8042cb885c88 00000004:00100000:0.0:1789776664.045717:0:17190:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789776664.045744:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8a5cf0ee1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776664.045804:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876716449597312:12345-0@lo:38:llog_process_th.0 Request processed in 222us (2730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.046196:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789776664.046262:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a5cff349880 x1876716449597312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776664.046285:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776664.046293:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789776664.046305:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789776664.046310:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789776664.046313:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cf0ee1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776664.046318:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876716449597312:0@lo:38:llog_process_th.0 00000001:00100000:1.0:1789776664.056507:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789776664.056570:0:17182:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789776664.056588:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789776664.056622:0:17206:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789776664.056627:0:17206:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789776664.056651:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056671:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056679:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056686:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056725:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056739:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776664.056753:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449597568:0@lo:104: 00000100:00100000:1.0:1789776664.056819:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776664.056874:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776664.056882:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 18 pid: 17182 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776664.056890:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449597696:0@lo:104: 00000100:00100000:0.0:1789776664.056903:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597568 00000100:00100000:1.0:1789776664.056910:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776664.056910:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597568 00000100:00100000:0.0:1789776664.056941:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597696 00000100:00100000:0.0:1789776664.056944:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597696 00000100:00100000:1.0:1789776664.056946:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776664.056957:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776664.056966:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449597568:12345-0@lo:104: 00010000:00010000:0.0:1789776664.056978:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.057142:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776664.057149:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449597568:12345-0@lo:104: Request processed in 184us (330us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776664.057187:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776664.057194:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.057202:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf800 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776664.057205:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.057213:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776664.057220:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776664.057226:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776664.057256:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.057263:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776664.057282:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.057289:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf800/0xf13b8042cb885c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c57 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.057302:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776664.057304:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776664.057306:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776664.057340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776664.057340:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776664.057361:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449597824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776664.057368:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776664.057374:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449597696:12345-0@lo:104: 00010000:00010000:0.0:1789776664.057382:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776664.057388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776664.057420:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776664.057431:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449597696:12345-0@lo:104: Request processed in 57us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.057437:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776664.057450:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17922:x1876716449597440:12345-0@lo:253:mount.lustre.0 Request processed in 12252us (12849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776664.057458:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776664.057465:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597824 00000100:00100000:0.0:1789776664.057468:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597824 00010000:00010000:0.0:1789776664.057482:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.057519:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776664.057526:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+18:3644:x1876716449597824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776664.057535:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:17922:1876716449597440:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1789776664.057536:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776664.057540:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776664.057545:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789776664.057548:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:0.0:1789776664.057549:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 18 pid: 17185 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789776664.057550:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789776664.057551:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776664.057553:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776664.057554:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776664.057555:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776664.057556:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776664.057558:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776664.057559:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1789776664.057564:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:02000000:1.0:1789776664.057572:0:17922:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789776664.057589:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+18:3644:x1876716449597824:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.057594:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776664.057620:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449597824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776664.057712:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2000/0xf13b8042cb885c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885c50 expref: 17 pid: 17185 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.057722:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449597568:0@lo:104: 00000100:00100000:0.0:1789776664.057731:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449597696:0@lo:104: 00010000:00010000:0.0:1789776664.057746:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.060244:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776664.060273:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.060283:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdec00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776664.060287:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.060298:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776664.060305:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776664.060310:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776664.060376:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.060383:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776664.060406:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.060411:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789776664.060412:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdec00/0xf13b8042cb885b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b93 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.060429:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449597952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776664.060430:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776664.060432:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776664.060433:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776664.060486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776664.060551:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449597952 00000100:00100000:0.0:1789776664.060557:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449597952 00010000:00010000:0.0:1789776664.060581:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 17 pid: 17182 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.060611:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776664.060620:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+17:3643:x1876716449597952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776664.060714:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776664.060721:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 17 pid: 17182 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.060733:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 17 pid: 17182 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.060745:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2400/0xf13b8042cb885b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885b8c expref: 17 pid: 17182 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.060759:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.060767:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776664.060782:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004156168s 00010000:00010000:0.0:1789776664.060787:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.060800:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061067:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061074:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061080:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776664.061084:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061092:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061116:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776664.061128:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776664.061393:0:17206:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.061403:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776664.061417:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb885c8f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776664.061876:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+16:3643:x1876716449597952:12345-0@lo:103:ldlm_bl.0 Request processed in 1183us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.061886:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776664.062128:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449597952:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1789776664.068278:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789776664.068378:0:17946:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789776664.068382:0:17946:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789776664.069547:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789776664.069565:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1789776664.070652:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776664.070723:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.070794:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776664.070832:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598080 00000100:00100000:3.0:1789776664.070838:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598080 00000100:00100000:3.0:1789776664.070884:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776664.070892:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598080:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.071013:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776664.071021:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776664.071046:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776664.071070:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598080:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789776664.071237:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789776664.071271:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789776664.071859:0:17922:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789776664.071867:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789776664.071902:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776664.073257:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789776664.073832:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789776664.073862:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789776664.073963:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789776664.074191:0:17948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789776664.074240:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598208:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.074314:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776664.074368:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598208 00000100:00100000:3.0:1789776664.074374:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598208 00000100:00100000:3.0:1789776664.074409:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776664.074416:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598208:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.074539:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598208:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776664.074558:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776664.074581:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776664.074605:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598208:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.074657:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17948:1876716449598336:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789776664.074684:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776664.074707:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc3667180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776664.075482:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598336 00000100:00100000:1.0:1789776664.075489:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598336 00000100:00100000:1.0:1789776664.075548:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776664.075556:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17948:x1876716449598336:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789776664.075617:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17948:x1876716449598336:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776664.075623:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:1.0:1789776664.076045:0:17922:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:2.0:1789776664.076746:0:17948:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a5cff498a80 x1876716449598336/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776664.076761:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17948:1876716449598336:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789776664.076829:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789776664.076879:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776664.076901:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd97df0c0 going to sleep for 11 seconds 00000040:00080000:0.0:1789776664.077387:0:17947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789776664.077453:0:17947:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789776664.077525:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598464 00000100:00100000:0.0:1789776664.077532:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598464 00000100:00100000:0.0:1789776664.077565:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776664.077574:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598464:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789776664.077973:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17948:x1876716449598464:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 399us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.077982:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776664.078221:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876716449598464:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789776664.078275:0:17948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1789776664.079160:0:17922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1789776664.080828:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789776664.080905:0:17948:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789776664.080910:0:17948:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789776664.090032:0:17922:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789776664.090069:0:17922:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaed6c1d8b988 00100000:10000000:1.0:1789776664.090077:0:17922:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789776664.090933:0:17922:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776664.090966:0:17922:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776664.090983:0:17922:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789776664.091005:0:17922:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789776664.093032:0:17922:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776664.093264:0:17922:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789776664.610653:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776664.995285:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000040:00080000:3.0:1789776665.132231:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789776665.634633:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789776665.634831:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789776665.634835:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc378a000 from 8 10000000:01000000:0.0:1789776665.634840:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776665.634884:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776665.634897:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776665.634908:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776665.634935:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776665.635001:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776665.635049:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776665.635867:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598592 00000100:00100000:1.0:1789776665.635876:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598592 00000100:00100000:1.0:1789776665.635932:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776665.635943:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+16:17188:x1876716449598592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776665.635957:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776665.635973:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885c96 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776665.635997:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776665.636007:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776665.636015:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1200, rc 0) 00000100:00100000:1.0:1789776665.636075:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449598592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776665.636082:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776665.636711:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776665.636729:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776665.636738:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776665.636799:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789776665.636839:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776665.636868:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfaea6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776665.636946:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598720 00000100:00100000:2.0:1789776665.636951:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598720 00000100:00100000:2.0:1789776665.636980:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776665.636988:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449598720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789776665.637003:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776665.637019:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776665.637022:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789776665.637117:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449598720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776665.637135:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776665.637173:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789776665.637212:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789776665.637219:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637227:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776665.637236:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789776665.637238:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc3db5000 from 8 10000000:01000000:2.0:1789776665.637240:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789776665.637258:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637264:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637272:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776665.637283:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776665.637309:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776665.637335:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd97dfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776665.637349:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598848 00000100:00100000:2.0:1789776665.637352:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598848 00000100:00100000:2.0:1789776665.637374:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789776665.637380:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449598848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776665.637388:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776665.637398:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885ca4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637419:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637427:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637434:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a2600, rc 0) 00000100:00100000:2.0:1789776665.637460:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449598848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776665.637466:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789776665.637510:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776665.637523:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776665.637531:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776665.640780:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789776665.640851:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776665.640887:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd97dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776665.644039:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449598976 00000100:00100000:1.0:1789776665.644052:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449598976 00000100:00100000:1.0:1789776665.644107:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776665.644117:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449598976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789776665.644142:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776665.644158:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776665.644161:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789776665.644280:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449598976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (3429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776665.644288:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776665.644351:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449598976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789776665.644407:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776665.644416:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776665.644428:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776666.018619:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000040:00080000:0.0:1789776666.148846:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776666.664854:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776667.042934:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:1.0:1789776667.683385:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776668.080013:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00010000:00010000:0.0:1789776668.711159:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776669.053400:0:18191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789776669.093077:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 0 seconds 00000100:00080000:0.0:1789776669.223860:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789776669.223866:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789776669.223870:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776669.223892:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a5cd0ed8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776669.223915:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff348e00 x1876716449599232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776669.223932:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776669.223935:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776669.223937:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776669.223939:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776669.223960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776669.223962:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776669.223965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776669.223967:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789776669.224002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449599104:0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.224113:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776669.224121:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449599360:0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.224180:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449599232:0@lo:38:kworker.0 00000100:00100000:0.0:1789776669.224219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.224248:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449599488:0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.224298:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776669.224303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449599616:0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.224363:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599104 00000100:00100000:0.0:1789776669.224369:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599104 00000100:00100000:0.0:1789776669.224413:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776669.224436:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:3645:x1876716449599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224486:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:3645:x1876716449599104:12345-0@lo:400:kworker.0 Request processed in 52us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.224519:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776669.224551:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599360 00000100:00100000:0.0:1789776669.224555:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599360 00000100:00100000:0.0:1789776669.224577:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599616 00000100:00100000:0.0:1789776669.224580:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599616 00000100:00100000:0.0:1789776669.224593:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776669.224600:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224629:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449599360:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.224634:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776669.224645:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776669.224651:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449599616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224681:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449599616:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.224687:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776669.224702:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599232 00000100:00100000:0.0:1789776669.224706:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599232 00000100:00100000:0.0:1789776669.224716:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599488 00000100:00100000:0.0:1789776669.224719:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599488 00000100:00100000:0.0:1789776669.224732:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789776669.224737:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876716449599232:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789776669.224759:0:17195:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:0.0:1789776669.224796:0:17195:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885cb2 00000004:00100000:0.0:1789776669.224810:0:17195:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789776669.224815:0:17195:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:0.0:1789776669.224910:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff34bb80 x1876716449599616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776669.224923:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449599616:0@lo:400:kworker.0 00010000:00080000:0.0:1789776669.224949:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff34a680 x1876716449599360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776669.224958:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449599360:0@lo:400:kworker.0 00000100:00100000:0.0:1789776669.224967:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449599104:0@lo:400:kworker.0 00000100:00100000:3.0:1789776669.225626:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776669.225639:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449599744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776669.225674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776669.225702:0:17196:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789776669.225709:0:17196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789776669.225801:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599744 00000100:00100000:3.0:1789776669.225812:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599744 00000100:00100000:3.0:1789776669.225896:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776669.225905:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876716449599488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776669.225946:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876716449599488:12345-0@lo:400:kworker.0 Request processed in 43us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.225953:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776669.225966:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776669.225972:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449599744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776669.225992:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789776669.226026:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449599744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.226032:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776669.226061:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449599744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776669.226143:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449599488:0@lo:400:kworker.0 00000100:00080000:0.0:1789776669.232580:0:17195:0:(import.c:65:import_set_state_nolock()) ffff8a5cd93f6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776669.232689:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449599232:12345-0@lo:38:kworker.0 Request processed in 7948us (8466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.232698:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789776669.232749:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789776669.232758:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789776669.232764:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789776669.232767:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd0ed8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789776669.232861:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000075e3fcd1): req@ffff8a5cff34b100 x1876716449592320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776669.235592:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449599872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776669.235662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.235718:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449599872 00000100:00100000:0.0:1789776669.235725:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449599872 00000100:00100000:0.0:1789776669.235764:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776669.235773:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449599872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776669.235808:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789776669.235882:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449599872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.235902:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776669.235945:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449599872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776669.239541:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449599232:0@lo:38:kworker.0 00000100:00100000:2.0:1789776669.239694:0:17232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776669.239723:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2efe480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776669.239783:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449592320 00000100:00100000:0.0:1789776669.239792:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449592320 00000100:00100000:0.0:1789776669.239847:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776669.239858:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449592320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789776669.239942:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449592320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.239949:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776669.240030:0:17232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1876716449592320:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789776669.240061:0:17232:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789776669.240101:0:17232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1876716449600000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789776669.240143:0:17232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776669.240178:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776669.240191:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600000 00000100:00100000:2.0:1789776669.240196:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600000 00000100:00100000:2.0:1789776669.240444:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776669.240452:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449600000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789776669.240585:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449600000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776669.240592:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776669.240663:0:17232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1876716449600000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789776669.240729:0:17232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1876716449600128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789776669.240771:0:17232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776669.243076:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfaea6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789776669.243170:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600128 00000100:00100000:0.0:1789776669.243178:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600128 00000100:00100000:0.0:1789776669.243229:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776669.243239:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449600128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789776669.243365:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17232:x1876716449600128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.243373:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776669.243527:0:17232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1876716449600128:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789776669.243580:0:17232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776669.245562:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789776669.245640:0:17232:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789776669.245645:0:17232:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789776669.731295:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789776670.104830:0:18244:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776670.105600:0:18244:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776670.754950:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789776670.969814:0:18295:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776670.970105:0:18295:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789776671.778840:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776672.166652:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1789776672.193981:0:18343:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca296e5d0 20000000:00000080:3.0:1789776672.194000:0:18343:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cf640a000 uarg=0000000000000000 20000000:01000000:3.0:1789776672.194041:0:18343:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789776672.194048:0:18343:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789776672.194053:0:18343:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789776672.195697:0:18344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789776672.195840:0:18343:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789776672.204272:0:18343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789776672.204311:0:18343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204331:0:18343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204339:0:18343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204346:0:18343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204392:0:18343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204409:0:18343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776672.204442:0:18343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1876716449600256:0@lo:104: 00000100:00100000:3.0:1789776672.204555:0:18343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776672.204615:0:18343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.204624:0:18343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 17 pid: 17184 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776672.204632:0:18343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1876716449600384:0@lo:104: 00000100:00100000:3.0:1789776672.204653:0:18343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776672.204668:0:18343:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfaea6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776672.204881:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600256 00000100:00100000:2.0:1789776672.204889:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600256 00000100:00100000:2.0:1789776672.204926:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600384 00000100:00100000:2.0:1789776672.204929:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600384 00000100:00100000:2.0:1789776672.204941:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776672.204949:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:18343:x1876716449600256:12345-0@lo:104: 00010000:00010000:2.0:1789776672.204961:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205021:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776672.205027:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:18343:x1876716449600256:12345-0@lo:104: Request processed in 79us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776672.205034:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776672.205050:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776672.205055:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:18343:x1876716449600384:12345-0@lo:104: 00010000:00010000:2.0:1789776672.205063:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205108:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776672.205113:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:18343:x1876716449600384:12345-0@lo:104: Request processed in 59us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776672.205119:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789776672.205135:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776672.205141:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205148:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0400 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776672.205159:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205168:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776672.205175:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776672.205180:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776672.205219:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205225:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776672.205243:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205249:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885c5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c65 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205271:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776672.205274:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205279:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776672.205282:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205288:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776672.205294:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776672.205299:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776672.205313:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205318:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776672.205324:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205331:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885b5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885b62 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205343:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776672.205345:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776672.205347:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776672.205353:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776672.205394:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449600512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776672.205426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776672.205455:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776672.205461:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449600640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776672.205482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776672.205546:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600512 00000100:00100000:2.0:1789776672.205550:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600512 00010000:00010000:2.0:1789776672.205570:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 18 pid: 17185 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776672.205589:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600640 00000100:00100000:2.0:1789776672.205593:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600640 00010000:00010000:2.0:1789776672.205603:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 19 pid: 17184 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776672.205614:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776672.205620:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+19:3643:x1876716449600512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776672.205631:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776672.205635:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 19 pid: 17185 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205646:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 19 pid: 17185 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205661:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776672.205690:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+19:3643:x1876716449600512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776672.205696:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776672.205708:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776672.205714:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+18:3643:x1876716449600640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776672.205728:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776672.205733:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 18 pid: 17184 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205742:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 18 pid: 17184 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205754:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205761:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205773:0:17175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205780:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205786:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205856:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205863:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776672.205867:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205874:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205896:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.205906:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776672.205930:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+18:3643:x1876716449600640:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776672.205937:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776672.205976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449600640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776672.205986:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449600512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776672.206607:0:18343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885c65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885c5e expref: 17 pid: 17185 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776672.206619:0:18343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1876716449600256:0@lo:104: 00010000:00010000:3.0:1789776672.206629:0:18343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885b62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885b5b expref: 16 pid: 17184 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776672.206637:0:18343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1876716449600384:0@lo:104: 00010000:00010000:3.0:1789776672.206655:0:18343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.206664:0:18343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.206670:0:18343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776672.206688:0:18343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cfc257000/0xf13b8042cb885cb9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.802777:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776673.314754:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776663/real 1789776663] req@ffff8a5cff35c380 x1876716449595520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776673 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776673.314786:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff35c380 x1876716449595520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776673 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776673.314797:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776663/real 1789776663] req@ffff8a5cff35d180 x1876716449595392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776673 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776673.314809:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff35d180 x1876716449595392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776673 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776673.314828:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776673.314851:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776673.314856:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449595520:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789776673.314862:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3c84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776673.314867:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776673.314885:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449595392:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789776673.315000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776673.315004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776673.315007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776673.315011:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776673.315030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776673.315033:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789776673.315036:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3c84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776673.315041:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:3.0:1789776673.315045:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776673.315052:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a5bc3c84000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776673.315069:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff49b800 x1876716449601280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776673.315080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776673.315083:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789776673.315085:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776673.315088:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:3.0:1789776673.315091:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776673.315094:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1789776673.315104:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff499180 x1876716449601408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776673.315196:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449600768:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.315307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449601536:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.315409:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776673.315415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449600896:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.315520:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449601024:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.315567:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776673.315573:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449601152:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.315624:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600896 00000100:00100000:2.0:1789776673.315631:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600896 00000100:00100000:2.0:1789776673.315667:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601152 00000100:00100000:2.0:1789776673.315669:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601152 00000100:00100000:2.0:1789776673.315681:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776673.315689:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449600896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315734:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449600896:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776673.315740:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776673.315754:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776673.315760:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449601152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315782:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449601152:12345-0@lo:400:kworker.0 Request processed in 23us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776673.315797:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776673.315829:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449601152:0@lo:400:kworker.0 00000100:00100000:2.0:1789776673.315845:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449601280:0@lo:8:kworker.0 00000400:00000100:2.0:1789776673.315866:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449601280 offset 0 length 520: 4 00000100:00100000:2.0:1789776673.315882:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449601408:0@lo:8:kworker.0 00000400:00000100:2.0:1789776673.315896:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449601408 offset 0 length 520: 4 00000100:00100000:2.0:1789776673.315916:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449600896:0@lo:400:kworker.0 00000100:00100000:3.0:1789776673.316236:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449600768 00000100:00100000:3.0:1789776673.316241:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449600768 00000100:00100000:3.0:1789776673.316279:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776673.316286:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+16:3645:x1876716449600768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776673.316324:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+16:3645:x1876716449600768:12345-0@lo:400:kworker.0 Request processed in 39us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776673.316330:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789776673.316477:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449600768:0@lo:400:kworker.0 00000100:00100000:0.0:1789776673.322097:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601536 00000100:00100000:0.0:1789776673.322113:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601536 00000100:00100000:0.0:1789776673.322219:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601024 00000100:00100000:0.0:1789776673.322223:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601024 00000100:00100000:3.0:1789776673.322865:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776673.322880:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449601536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776673.322991:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449601536:12345-0@lo:400:kworker.0 Request processed in 116us (7605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776673.322998:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776673.323020:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776673.323026:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449601024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776673.323059:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449601024:12345-0@lo:400:kworker.0 Request processed in 33us (7508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776673.323065:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789776673.323159:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff498000 x1876716449601024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776673.323186:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449601024:0@lo:400:kworker.0 00010000:00080000:2.0:1789776673.323226:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5bc3d1c380 x1876716449601536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776673.323236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449601536:0@lo:400:kworker.0 10000000:01000000:2.0:1789776673.447083:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776673.447092:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc378a000 from 13 10000000:01000000:2.0:1789776673.447099:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776673.447149:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776673.447162:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776673.447183:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776673.447221:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776673.447290:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776673.447325:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776673.460596:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601664 00000100:00100000:0.0:1789776673.460614:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601664 00000100:00100000:0.0:1789776673.460691:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776673.460703:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+16:17188:x1876716449601664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776673.460720:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776673.460741:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885cc0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.460783:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.460794:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.460802:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cde800, rc 0) 00000100:00100000:0.0:1789776673.460883:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449601664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (13592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776673.460889:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776673.460945:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776673.460963:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.460972:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776673.461207:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776673.461238:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776673.461274:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776673.461333:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601792 00000100:00100000:2.0:1789776673.461339:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601792 00000100:00100000:2.0:1789776673.461373:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776673.461380:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449601792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776673.461510:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449601792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776673.461517:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789776673.461598:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776673.461626:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776673.461663:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776673.461729:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776673.465686:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449601920 00000100:00100000:2.0:1789776673.465703:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449601920 00000100:00100000:2.0:1789776673.465771:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776673.465786:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449601920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776673.465969:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449601920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776673.465976:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776673.466513:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449601920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776673.474816:0:18395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789776673.475179:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789776673.475205:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776673.475216:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776673.475229:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776673.475241:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776673.475250:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc3db5000 from 13 10000000:01000000:3.0:1789776673.475253:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776673.475292:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776673.475300:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776673.475312:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776673.475338:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776673.475406:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776673.475441:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfaea66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776673.476265:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602048 00000100:00100000:0.0:1789776673.476285:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602048 00000100:00100000:0.0:1789776673.476347:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776673.476357:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+17:17188:x1876716449602048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776673.476371:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776673.476386:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885cce expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.476411:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885cce expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.476422:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885cce expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776673.476431:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cde600, rc 0) 00000100:00100000:0.0:1789776673.476518:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449602048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776673.476524:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776673.476904:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776673.476937:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776673.476948:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776673.477024:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776673.477058:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776673.477096:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cdb6dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776673.477124:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602176 00000100:00100000:3.0:1789776673.477130:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602176 00000100:00100000:3.0:1789776673.477167:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776673.477184:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449602176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776673.477306:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449602176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776673.477313:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789776673.477378:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776673.477406:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776673.477448:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776673.477486:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cdb6dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776673.477786:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602304 00000100:00100000:3.0:1789776673.477791:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602304 00000100:00100000:3.0:1789776673.477828:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789776673.477836:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449602304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776673.477925:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:17188:x1876716449602304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776673.477932:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789776673.478274:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449602304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776673.482311:0:18397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789776673.484686:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789776673.484743:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776673.484756:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776673.484769:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776673.830520:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776674.340857:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776674.340882:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449602432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776674.340958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776674.341005:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602432 00000100:00100000:3.0:1789776674.341012:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602432 00000100:00100000:3.0:1789776674.341060:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776674.341069:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449602432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776674.341119:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789776674.341297:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449602432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776674.341305:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776674.341526:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449602432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776674.342477:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449602560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776674.342548:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776674.342600:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602560 00000100:00100000:1.0:1789776674.342607:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602560 00000100:00100000:1.0:1789776674.342647:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776674.342654:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449602560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776674.342702:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789776674.342752:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449602560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776674.342781:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776674.342823:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449602560:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789776674.853910:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789776674.862225:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776675.375724:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776660/real 1789776660] req@ffff8a5cff498380 x1876716449593344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776675.375756:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff498380 x1876716449593344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776675.375767:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776660/real 1789776660] req@ffff8a5cff499f80 x1876716449593472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776675.375794:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff499f80 x1876716449593472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776675.375815:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776675.375832:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776675.375837:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593344:0@lo:8:kworker.0 00000100:00080000:2.0:1789776675.375905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.375909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789776675.375911:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776675.375916:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:2.0:1789776675.375922:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789776675.375928:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a5cfaf0e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776675.375946:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e90000 x1876716449602944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776675.376471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.376475:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776675.376527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.376531:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776675.376534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.376537:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789776675.376574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449602688:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.376714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776675.376781:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449603328:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.376811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776675.376835:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776675.376840:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449603200:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776675.377265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449602816:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776675.377326:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776675.377332:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449603072:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776675.377398:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603200 00000100:00100000:2.0:1789776675.377406:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603200 00000100:00100000:2.0:1789776675.377453:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602816 00000100:00100000:2.0:1789776675.377457:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602816 00000100:00100000:2.0:1789776675.377476:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776675.377485:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449603200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377567:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449603200:12345-0@lo:400:kworker.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776675.377575:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776675.377760:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776675.377768:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449602816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377812:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449602816:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776675.377819:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776675.377845:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603328 00000100:00100000:2.0:1789776675.377849:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603328 00000100:00100000:2.0:1789776675.377874:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603072 00000100:00100000:2.0:1789776675.377884:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603072 00000100:00100000:2.0:1789776675.377906:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776675.377913:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449603328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.377946:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449603328:12345-0@lo:400:kworker.0 Request processed in 33us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776675.378053:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776675.378065:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776675.378071:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449603072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.378114:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449603072:12345-0@lo:400:kworker.0 Request processed in 43us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776675.378120:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776675.378173:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449603200:0@lo:400:kworker.0 00010000:00080000:2.0:1789776675.378187:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5bc3e90700 x1876716449603328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776675.378198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449603328:0@lo:400:kworker.0 00010000:00080000:2.0:1789776675.378226:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5bc3e92d80 x1876716449603072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776675.378235:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449603072:0@lo:400:kworker.0 00000100:00100000:2.0:1789776675.378244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449602816:0@lo:400:kworker.0 00000100:00080000:2.0:1789776675.378263:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776675.378276:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776675.378280:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449593472:0@lo:8:kworker.0 00000100:00080000:2.0:1789776675.378302:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.378312:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789776675.378315:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776675.378319:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:2.0:1789776675.378323:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789776675.378328:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776675.378353:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff499f80 x1876716449603456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776675.378366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.378369:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776675.378371:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776675.378374:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789776675.378391:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449602944:0@lo:8:kworker.0 00000400:00000100:2.0:1789776675.378423:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449602944 offset 0 length 520: 4 00000100:00100000:2.0:1789776675.378451:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449603456:0@lo:8:kworker.0 00000400:00000100:2.0:1789776675.378672:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716449603456 offset 0 length 520: 4 00000100:00100000:0.0:1789776675.389348:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449602688 00000100:00100000:0.0:1789776675.389360:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449602688 00000100:00100000:0.0:1789776675.389420:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776675.389431:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:3644:x1876716449602688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776675.389538:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+18:3644:x1876716449602688:12345-0@lo:400:kworker.0 Request processed in 109us (12823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776675.389547:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776675.389799:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449602688:0@lo:400:kworker.0 00010000:00010000:1.0:1789776675.875175:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776676.388229:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776676.899715:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776677.926837:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776678.946790:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789776679.405208:0:18691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789776679.405211:0:18691:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789776679.405213:0:18691:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789776679.405819:0:18691:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5bc3457800 00000020:01000004:1.0:1789776679.405836:0:18691:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789776679.405849:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789776679.405862:0:18691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a5cefa9cd28) 00000020:00000080:1.0:1789776679.405877:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1789776679.461654:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449603584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776679.461723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.461802:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603584 00000100:00100000:2.0:1789776679.461808:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603584 00000100:00100000:2.0:1789776679.461846:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776679.461854:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449603584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776679.461886:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789776679.461925:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449603584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.461946:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776679.462240:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449603712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776679.462269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776679.462304:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603712 00000100:00100000:3.0:1789776679.462309:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603712 00000100:00100000:3.0:1789776679.462335:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776679.462341:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449603712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776679.462368:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789776679.462402:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449603712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.462409:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776679.462464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449603712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776679.464297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449603584:0@lo:41:osp-pre-0-1.0 00100000:10000000:0.0:1789776679.510470:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789776679.512878:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789776679.513383:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789776679.515189:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789776679.515485:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789776679.515847:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789776679.516193:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1789776679.523216:0:18691:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789776679.523774:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789776679.523787:0:18691:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789776679.523843:0:18691:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf13b8042cb885ce3 00000020:01000004:0.0:1789776679.523852:0:18691:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789776679.523877:0:18691:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789776679.523894:0:18691:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789776679.523902:0:18691:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789776679.523907:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789776679.523921:0:18691:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a5cc8c60000) 00000020:00000080:0.0:1789776679.523932:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789776679.525128:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776679.525317:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789776679.525322:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789776679.537975:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789776679.537994:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789776679.540924:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789776679.540937:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789776679.543154:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776679.545087:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789776679.545098:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789776679.547109:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789776679.547125:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789776679.578147:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776679.579036:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789776679.579044:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789776679.584404:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789776679.584420:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789776679.588086:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776679.588105:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789776679.593344:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776679.594154:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789776679.594161:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789776679.595395:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789776679.595404:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789776679.662994:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776679.663271:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789776679.663278:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789776679.665272:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789776679.665284:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789776679.670563:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789776679.670608:0:18691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789776679.670615:0:18691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789776679.692283:0:18691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789776679.692327:0:18691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789776679.692331:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789776679.692332:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789776679.692334:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776679.692335:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776679.692336:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776679.692337:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776679.692338:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776679.692345:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776679.692346:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776679.692350:0:18691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789776679.692352:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776679.692353:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789776679.692354:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776679.692355:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776679.692355:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776679.692357:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776679.692357:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776679.692358:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776679.692359:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776679.692396:0:18691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789776679.692420:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449603840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789776679.692635:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.692715:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce2627d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.692758:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603840 00000100:00100000:0.0:1789776679.692765:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603840 00000100:00100000:0.0:1789776679.692868:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776679.692877:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:18691:x1876716449603840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789776679.692915:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789776679.692919:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789776679.692922:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789776679.694243:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:18691:x1876716449603840:12345-0@lo:253:mount.lustre.0 Request processed in 1359us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.694256:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776679.694585:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449603840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789776679.694602:0:18691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789776679.694605:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776679.694607:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789776679.694608:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776679.694609:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776679.694610:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776679.694612:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776679.694613:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776679.694615:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776679.694616:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789776679.694638:0:18691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc3457800 from lustre-OST0000 10000000:01000000:1.0:1789776679.694671:0:18691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789776679.694674:0:18691:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789776679.694683:0:18691:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5bc273b370 local copy 00010000:00010000:1.0:1789776679.694697:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.694805:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449603968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776679.694860:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.694903:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.695355:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449603968 00000100:00100000:0.0:1789776679.695362:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449603968 00000100:00100000:0.0:1789776679.695412:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789776679.695420:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:18691:x1876716449603968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776679.695540:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+18:18691:x1876716449603968:12345-0@lo:501:mount.lustre.0 Request processed in 120us (678us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776679.695546:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776679.695695:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449603968:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789776679.695711:0:18691:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789776679.695731:0:18691:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789776679.695738:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.695747:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776679.695774:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5bc3457800 10000000:01000000:1.0:1789776679.695778:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789776679.695783:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789776679.695786:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776679.695790:0:18691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789776679.695793:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789776679.695817:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.695824:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.695832:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.695847:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776679.695877:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.695905:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.695958:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604096 00000100:00100000:0.0:1789776679.695963:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604096 00000100:00100000:0.0:1789776679.695999:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789776679.696006:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+18:18691:x1876716449604096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776679.696014:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776679.696026:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdfe00/0xf13b8042cb885cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885cf1 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.696046:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdfe00/0xf13b8042cb885cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885cf1 expref: 19 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.696065:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdfe00/0xf13b8042cb885cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885cf1 expref: 19 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.696084:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfe00, rc 0) 00000100:00100000:0.0:1789776679.696195:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604096:12345-0@lo:101:mount.lustre.0 Request processed in 189us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.696201:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776679.696449:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776679.696462:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cf8 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.696471:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885cf8 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776679.697953:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789776679.699264:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776679.704679:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789776679.704729:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789776679.704740:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789776679.704751:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789776679.704762:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789776679.704773:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789776679.704793:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789776679.704798:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789776679.704898:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776679.705064:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.705397:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.705462:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604224 00000100:00100000:0.0:1789776679.705469:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604224 00000100:00100000:2.0:1789776679.705778:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776679.705790:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776679.705954:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604224:12345-0@lo:501:mount.lustre.0 Request processed in 167us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.705962:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789776679.706041:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776679.706105:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776679.706159:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.706415:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776679.706675:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604352 00000100:00100000:3.0:1789776679.706682:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604352 00000100:00100000:3.0:1789776679.706712:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789776679.706719:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776679.708577:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604352:12345-0@lo:503:mount.lustre.0 Request processed in 1772us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.708591:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776679.711726:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789776679.712709:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776679.712816:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776679.712890:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776679.712935:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.713002:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604480 00000100:00100000:1.0:1789776679.713008:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604480 00000100:00100000:1.0:1789776679.713070:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789776679.713079:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776679.713751:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604480:12345-0@lo:502:mount.lustre.0 Request processed in 671us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.713760:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776679.713961:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776679.714419:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789776679.714456:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789776679.714470:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789776679.714482:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789776679.714521:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789776679.714539:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789776679.714551:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789776679.714564:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789776679.714593:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789776679.714608:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789776679.714622:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789776679.714635:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789776679.714667:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776679.714717:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776679.714745:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.714817:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604608 00000100:00100000:1.0:1789776679.714823:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604608 00000100:00100000:1.0:1789776679.714866:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776679.714874:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776679.714977:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604608:12345-0@lo:502:mount.lustre.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.714984:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789776679.715438:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776679.715487:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789776679.715527:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789776679.716443:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776679.716452:0:18708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789776679.716458:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776679.716461:0:18708:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789776679.716466:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776679.716482:0:18708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a5cc8c64d28) 00000020:00000080:0.0:1789776679.716680:0:18708:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789776679.716767:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789776679.716844:0:18708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3457800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789776679.716853:0:18708:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789776679.716860:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf13b8042cb885d06 00010000:00010000:1.0:1789776679.721994:0:18708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789776679.722775:0:18708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1789776679.725699:0:18708:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789776679.728067:0:18708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789776679.728079:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776679.728086:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728088:0:18708:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789776679.728102:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789776679.728105:0:18708:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789776679.728106:0:18708:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789776679.728107:0:18708:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789776679.728109:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789776679.728112:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728113:0:18708:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789776679.728126:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776679.728129:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728130:0:18708:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776679.728133:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776679.728143:0:18708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789776679.728146:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776679.728149:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728150:0:18708:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789776679.728152:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776679.728154:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728156:0:18708:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789776679.728159:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789776679.728188:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776679.728191:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776679.728192:0:18708:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789776679.728195:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789776679.728688:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789776679.728723:0:18691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789776679.728777:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cf8 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.728790:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0a00/0xf13b8042cb885cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885cf8 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776679.728801:0:18691:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc3457800 from 1 10000000:01000000:0.0:1789776679.728805:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776679.728841:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.728850:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.728872:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776679.728897:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776679.728981:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.729034:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776679.729259:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604736 00000100:00100000:2.0:1789776679.729267:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604736 00000100:00100000:2.0:1789776679.729319:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776679.729328:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+19:18691:x1876716449604736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776679.729341:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776679.729354:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885d0d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.729376:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.729387:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.729395:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3000, rc 0) 00000100:00100000:2.0:1789776679.729433:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449604736:12345-0@lo:101:mount.lustre.0 Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.729440:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789776679.729591:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776679.729605:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.729613:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776679.730741:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789776679.732462:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776679.732703:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789776679.732731:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789776679.732749:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789776679.732754:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789776679.732839:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776679.732903:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.733372:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.734109:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604864 00000100:00100000:0.0:1789776679.734119:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604864 00000100:00100000:0.0:1789776679.734173:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789776679.734182:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449604864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776679.734332:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449604864:12345-0@lo:501:mount.lustre.0 Request processed in 150us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.734346:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776679.734364:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776679.734432:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776679.734482:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.734538:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776679.734607:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449604992 00000100:00100000:3.0:1789776679.734612:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449604992 00000100:00100000:3.0:1789776679.734686:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776679.734694:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449604992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776679.734780:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449604992:12345-0@lo:503:mount.lustre.0 Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.734786:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789776679.735106:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449604992:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789776679.735752:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776679.735827:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776679.736370:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.736402:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4f76000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776679.737595:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605120 00000100:00100000:0.0:1789776679.737607:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605120 00000100:00100000:0.0:1789776679.737671:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789776679.737682:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449605120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776679.737836:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449605120:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.737843:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789776679.738341:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776679.738598:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789776679.738629:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789776679.738643:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789776679.738655:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789776679.738669:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789776679.738680:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789776679.738695:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789776679.738706:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789776679.738719:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789776679.738732:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789776679.738744:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789776679.738784:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776679.738834:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776679.738867:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605248 00000100:00100000:3.0:1789776679.738872:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605248 00000100:00100000:3.0:1789776679.738905:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776679.738912:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449605248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776679.738988:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449605248:12345-0@lo:502:mount.lustre.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.738995:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776679.739040:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776679.739066:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776679.739103:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789776679.739110:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789776679.743387:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776679.743398:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743400:0:18712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789776679.743407:0:18712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc3457800 00000020:00000080:2.0:1789776679.743409:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776679.743417:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776679.743419:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743420:0:18712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789776679.743422:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776679.743424:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743426:0:18712:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776679.743429:0:18712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc3457800 00000020:00000080:2.0:1789776679.743431:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776679.743486:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776679.743489:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743679:0:18712:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789776679.743684:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776679.743688:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743689:0:18712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776679.743693:0:18712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc3457800 00000020:00000080:2.0:1789776679.743695:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776679.743716:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776679.743724:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743726:0:18712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776679.743729:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776679.743732:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743733:0:18712:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789776679.743736:0:18712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc3457800 00000020:00000080:2.0:1789776679.743738:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776679.743763:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776679.743766:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776679.743768:0:18712:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789776679.743771:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789776679.744828:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789776679.744866:0:18691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776679.745128:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.745141:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776679.745201:0:18691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789776679.745204:0:18691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5bc3457800 10000000:01000000:0.0:1789776679.745207:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5bc3457800 10000000:01000000:0.0:1789776679.745210:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776679.745216:0:18691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc3457800 from 1 10000000:01000000:0.0:1789776679.745219:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776679.745256:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.745265:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.745275:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776679.745309:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776679.745377:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.745427:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605376 00000100:00100000:0.0:1789776679.745427:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cfaea6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789776679.745434:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605376 00000100:00100000:2.0:1789776679.745481:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776679.745504:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:18691:x1876716449605376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776679.745639:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776679.745653:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a3e00/0xf13b8042cb885d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885d1b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.745676:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a3e00/0xf13b8042cb885d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885d1b expref: 21 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.745686:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc31a3e00/0xf13b8042cb885d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d1b expref: 21 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.745694:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc31a3e00, rc 0) 00000100:00100000:2.0:1789776679.745733:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605376:12345-0@lo:101:mount.lustre.0 Request processed in 244us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.745740:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789776679.746839:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776679.746859:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d22 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.746869:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885d22 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776679.751001:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789776679.751335:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776679.751805:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789776679.751834:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789776679.751846:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789776679.751858:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789776679.751871:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789776679.751883:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789776679.751896:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789776679.751907:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789776679.751918:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789776679.751929:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789776679.751941:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789776679.751953:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789776679.751966:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789776679.751980:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789776679.751992:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789776679.752018:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789776679.752034:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789776679.752071:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789776679.752087:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789776679.752100:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789776679.752536:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789776679.752563:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789776679.752578:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789776679.752591:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789776679.752603:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789776679.752616:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789776679.752628:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789776679.752640:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789776679.752653:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789776679.752666:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789776679.752678:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789776679.752704:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789776679.752720:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789776679.752732:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789776679.752744:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789776679.752758:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789776679.752770:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789776679.752790:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789776679.752795:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789776679.752898:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776679.752964:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.753004:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.753335:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605504 00000100:00100000:1.0:1789776679.753343:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605504 00000100:00100000:1.0:1789776679.753399:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789776679.753409:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776679.753562:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605504:12345-0@lo:501:mount.lustre.0 Request processed in 154us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.753570:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789776679.753717:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776679.753753:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789776679.753796:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.753828:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc2d92d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.754897:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605632 00000100:00100000:1.0:1789776679.754927:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605632 00000100:00100000:1.0:1789776679.754971:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789776679.754980:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776679.755135:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605632:12345-0@lo:503:mount.lustre.0 Request processed in 156us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.755142:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789776679.756557:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605632:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789776679.757708:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789776679.757805:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776679.757882:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.757982:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce1c6ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.759554:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605760 00000100:00100000:1.0:1789776679.759567:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605760 00000100:00100000:1.0:1789776679.759720:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789776679.759731:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776679.759897:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605760:12345-0@lo:502:mount.lustre.0 Request processed in 168us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.759905:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789776679.760079:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789776679.760487:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789776679.760550:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789776679.760566:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789776679.760580:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789776679.760592:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789776679.760628:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789776679.760645:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789776679.760671:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789776679.760686:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789776679.760696:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789776679.760708:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789776679.760720:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789776679.760734:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789776679.760746:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789776679.760760:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789776679.760773:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789776679.760785:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789776679.760798:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789776679.760810:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789776679.760823:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789776679.760836:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789776679.760847:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789776679.760860:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789776679.760887:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789776679.760902:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789776679.761705:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789776679.761720:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789776679.761732:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789776679.761744:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789776679.761757:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789776679.761769:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789776679.761780:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789776679.761791:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789776679.761801:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789776679.761813:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789776679.761825:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789776679.761836:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789776679.761847:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789776679.761859:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789776679.761892:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789776679.761992:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789776679.762012:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789776679.762028:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789776679.762043:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789776679.762067:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789776679.762080:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789776679.762094:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789776679.762106:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789776679.762173:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776679.762603:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.762650:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce1c6ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.763440:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449605888 00000100:00100000:1.0:1789776679.763450:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449605888 00000100:00100000:1.0:1789776679.763520:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789776679.763532:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776679.763672:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449605888:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.763680:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776679.763870:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449605888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789776679.764346:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789776679.764375:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789776679.764407:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449606016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776679.764461:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.764567:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce1c6ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.770475:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606016 00000100:00100000:1.0:1789776679.770520:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606016 00000100:00100000:1.0:1789776679.770599:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789776679.770609:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449606016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776679.770783:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449606016:12345-0@lo:502:mount.lustre.0 Request processed in 174us (6320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.770800:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789776679.772067:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449606016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789776679.772356:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789776679.772372:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789776679.777425:0:18717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789776679.777457:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a5bc3d919b8) 00000020:00000080:0.0:1789776679.777481:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789776679.778186:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3457800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789776679.778193:0:18717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc3457800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789776679.778195:0:18717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc3457800 3 00010000:00080000:0.0:1789776679.778338:0:18717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc1bb2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1789776679.784032:0:18717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789776679.787000:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789776679.787084:0:18717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789776679.787423:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf13b8042cb885d30 00000100:00080000:0.0:1789776679.787435:0:18717:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776679.787441:0:18717:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a5bc1bb2800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776679.787474:0:18717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff34bb80 x1876716449606144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776679.787509:0:18717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789776679.787563:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.787567:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.787570:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.787573:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.787597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.787696:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.787699:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.787701:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789776679.787755:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449606272:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.787822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.787857:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776679.787862:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449606400:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.787887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.787963:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449606144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776679.788098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449606528:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.788193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.788290:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776679.788297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449606656:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.788322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.788360:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606272 00000100:00100000:0.0:1789776679.788366:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606272 00000100:00100000:0.0:1789776679.788400:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606528 00000100:00100000:0.0:1789776679.788403:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606528 00000100:00100000:3.0:1789776679.788415:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606400 00000100:00100000:0.0:1789776679.788418:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776679.788419:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606400 00000100:00100000:0.0:1789776679.788425:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449606272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776679.788443:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606656 00000100:00100000:3.0:1789776679.788445:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606656 00000100:00100000:3.0:1789776679.788458:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789776679.788463:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.788475:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449606272:12345-0@lo:400:kworker.0 Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.788481:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776679.788759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.788817:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776679.788825:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.788903:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449606528:12345-0@lo:400:kworker.0 Request processed in 79us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.788925:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776679.788947:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789776679.788955:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1789776679.789065:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff348380 x1876716449606400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776679.789079:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449606400:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.789102:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449606272:0@lo:400:kworker.0 00000100:00100000:3.0:1789776679.789121:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449606400:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.789130:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789776679.789144:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606144 00000100:00100000:3.0:1789776679.789147:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606144 00000100:00100000:3.0:1789776679.789160:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776679.789166:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449606656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776679.789197:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449606656:12345-0@lo:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.789209:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776679.789222:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776679.789226:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876716449606144:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789776679.789246:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:3.0:1789776679.789286:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf13b8042cb885d37 00000004:00100000:3.0:1789776679.789302:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776679.789333:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776679.789389:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876716449606144:12345-0@lo:38:llog_process_th.0 Request processed in 161us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.789395:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789776679.790343:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff34bb80 x1876716449606144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776679.790351:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449606528:0@lo:400:kworker.0 00000100:00100000:0.0:1789776679.790353:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776679.790361:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789776679.790368:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789776679.790373:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00010000:00080000:1.0:1789776679.790375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff348700 x1876716449606656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776679.790376:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1bb2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776679.790381:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876716449606144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789776679.790384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449606656:0@lo:400:kworker.0 00000020:01000004:1.0:1789776679.792467:0:18717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789776679.792484:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a5cefa98000) 00000020:00000080:1.0:1789776679.793896:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789776679.794015:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc3457800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789776679.794020:0:18717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc3457800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789776679.794023:0:18717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc3457800 3 00010000:00080000:1.0:1789776679.794079:0:18717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc1a65000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1789776679.796466:0:18717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789776679.799664:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789776679.799712:0:18717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789776679.799727:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf13b8042cb885d45 00000100:00080000:1.0:1789776679.799739:0:18717:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776679.799744:0:18717:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a5bc1a65000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776679.799783:0:18717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff35ea00 x1876716449606784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776679.799812:0:18717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789776679.800134:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449606784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776679.800202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776679.800264:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.800269:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.800272:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.800275:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.800278:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.800290:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776679.800293:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776679.800295:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789776679.800662:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606784 00000100:00100000:1.0:1789776679.800670:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606784 00000100:00100000:1.0:1789776679.800713:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776679.800721:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876716449606784:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789776679.800748:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1789776679.800800:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf13b8042cb885d4c 00000004:00100000:1.0:1789776679.800814:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789776679.800845:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a65800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776679.800896:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876716449606784:12345-0@lo:38:llog_process_th.0 Request processed in 174us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.800904:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789776679.801730:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a5cff35ea00 x1876716449606784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776679.801742:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776679.801750:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789776679.801757:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789776679.801761:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789776679.801764:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc1a65000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776679.801770:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876716449606784:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789776679.801908:0:18717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789776679.802271:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789776679.802298:0:18691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776679.802319:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d22 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.802330:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde400/0xf13b8042cb885d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d22 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789776679.802376:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789776679.802378:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776679.802379:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776679.802380:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776679.802381:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776679.802383:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776679.802384:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776679.802386:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776679.802387:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776679.802395:0:18691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789776679.802397:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776679.802398:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776679.802399:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776679.802400:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776679.802401:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776679.802401:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776679.802402:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776679.802403:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776679.802404:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776679.802424:0:18691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789776679.802441:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449606912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789776679.803175:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776679.803226:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5bc2581480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.803428:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449606912 00000100:00100000:1.0:1789776679.803435:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449606912 00000100:00100000:1.0:1789776679.803485:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789776679.803511:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449606912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789776679.803597:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789776679.803613:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789776679.816812:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789776679.816832:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789776679.816997:0:17206:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789776679.817003:0:17206:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789776679.817033:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.817061:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.817069:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.817076:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776679.817324:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:18691:x1876716449606912:12345-0@lo:253:mount.lustre.0 Request processed in 13828us (14147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776679.817335:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789776679.817448:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:18691:1876716449606912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789776679.817462:0:18691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789776679.817466:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776679.817468:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789776679.817469:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776679.817470:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776679.817471:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776679.817472:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776679.817474:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776679.817475:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776679.817477:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789776679.817510:0:18691:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789776679.817594:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.817619:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 20 pid: 17184 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.817633:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449607040:0@lo:104: 00000100:00100000:2.0:1789776679.817670:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776679.817712:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.817721:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 20 pid: 17185 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.817730:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449607168:0@lo:104: 00000100:00100000:2.0:1789776679.817753:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.817769:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4f76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776679.817790:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789776679.817801:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607040 00000100:00100000:2.0:1789776679.817813:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607040 00000100:00100000:2.0:1789776679.817838:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607168 00000100:00100000:2.0:1789776679.817840:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607168 00000100:00100000:2.0:1789776679.817853:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776679.817860:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449607040:12345-0@lo:104: 00010000:00010000:2.0:1789776679.817871:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818225:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776679.818232:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449607040:12345-0@lo:104: Request processed in 372us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.818239:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776679.818255:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776679.818261:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf513e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449607168:12345-0@lo:104: 00010000:00010000:2.0:1789776679.818269:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818307:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776679.818313:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf513e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449607168:12345-0@lo:104: Request processed in 53us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.818319:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789776679.818398:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776679.818405:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.818418:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776679.818422:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.818430:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776679.818436:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776679.818440:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776679.818468:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.818473:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776679.818488:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.818511:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3600/0xf13b8042cb885ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cab expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.818655:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449607040:0@lo:104: 00000100:00100000:2.0:1789776679.818670:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449607168:0@lo:104: 00010000:00010000:2.0:1789776679.818686:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818701:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776679.818776:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.818787:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818794:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:2.0:1789776679.818797:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818804:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776679.818810:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776679.818814:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776679.818841:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818847:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776679.818853:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818859:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf200/0xf13b8042cb885c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885c9d expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.818872:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.818874:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.818876:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.818881:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.818882:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789776679.819610:0:18691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789776679.821011:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776679.821017:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776679.821019:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776679.821588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449607424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776679.821658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.822060:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776679.822068:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449607296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776679.822109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789776679.823263:0:18691:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789776679.823271:0:18691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789776679.823306:0:18691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789776679.823348:0:18691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789776679.823368:0:18691:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789776679.823387:0:18691:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:3.0:1789776679.823967:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607424 00000100:00100000:3.0:1789776679.823977:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607424 00010000:00010000:3.0:1789776679.824014:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 21 pid: 17185 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776679.824043:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607296 00000100:00100000:3.0:1789776679.824057:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607296 00010000:00010000:3.0:1789776679.824070:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 22 pid: 17184 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776679.824085:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776679.824094:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+22:3644:x1876716449607424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776679.824107:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776679.824113:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 22 pid: 17185 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824136:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 22 pid: 17185 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824154:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885c96 expref: 22 pid: 17185 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824167:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776679.824231:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+21:3644:x1876716449607424:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.824241:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776679.824258:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776679.824264:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+20:3644:x1876716449607296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776679.824271:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776679.824275:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 20 pid: 17184 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824284:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 20 pid: 17184 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824294:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2600/0xf13b8042cb885cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885ca4 expref: 20 pid: 17184 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824304:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824312:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789776679.824327:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007324537s 00010000:00010000:3.0:1789776679.824338:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824344:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824351:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824356:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824362:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776679.824366:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824374:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824389:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.824398:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776679.824423:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+19:3644:x1876716449607296:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.824429:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776679.824519:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449607296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776679.824530:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449607424:0@lo:103:ldlm_bl.0 00000020:00000004:0.0:1789776679.825435:0:18691:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776679.825667:0:18691:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789776679.830489:0:17206:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.830520:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776679.830528:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a2a00/0xf13b8042cb885d53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.970624:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789776680.679568:0:18773:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776680.679761:0:18773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789776680.995083:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789776681.638644:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789776681.638653:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc378a000 from 9 10000000:01000000:2.0:1789776681.638657:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789776681.638710:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.638724:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.638735:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776681.638761:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.638837:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776681.638882:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776681.639278:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607552 00000100:00100000:1.0:1789776681.639287:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607552 00000100:00100000:1.0:1789776681.639346:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789776681.639357:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+19:17188:x1876716449607552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776681.639370:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776681.639385:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885d5a expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.639410:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 20 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.639422:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 20 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.639432:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1200, rc 0) 00000100:00100000:1.0:1789776681.639478:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+20:17188:x1876716449607552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.639484:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789776681.639882:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776681.639899:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.639908:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776681.639982:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.640038:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776681.640070:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776681.640193:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607680 00000100:00100000:1.0:1789776681.640198:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607680 00000100:00100000:1.0:1789776681.640232:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789776681.640239:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:17188:x1876716449607680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789776681.640255:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776681.640272:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776681.640275:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789776681.640368:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:17188:x1876716449607680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.640384:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789776681.640453:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789776681.640549:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789776681.640557:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.640565:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776681.640575:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789776681.640578:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc3db5000 from 9 10000000:01000000:3.0:1789776681.640581:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789776681.640603:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.640609:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.640617:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776681.640633:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776681.640662:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776681.640683:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8736780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776681.640812:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607808 00000100:00100000:1.0:1789776681.640817:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607808 00000100:00100000:1.0:1789776681.640849:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776681.640856:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+20:17188:x1876716449607808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776681.640864:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776681.640877:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885d68 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.640893:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.640903:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.640911:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1e00, rc 0) 00000100:00100000:1.0:1789776681.640944:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:17188:x1876716449607808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.640950:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776681.640981:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776681.640991:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.640999:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776681.641143:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.641194:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.641252:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776681.645136:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449607936 00000100:00100000:3.0:1789776681.645152:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449607936 00000100:00100000:3.0:1789776681.646259:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789776681.646274:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:17188:x1876716449607936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789776681.646300:0:17185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789776681.646319:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789776681.646326:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789776681.646458:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:17188:x1876716449607936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 189us (5263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.646466:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789776681.652383:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449607936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789776681.652481:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776681.652523:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.652535:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776682.019539:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789776682.405753:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789776683.042708:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776684.067941:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776684.582787:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776684.582811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449608064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776684.582885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776684.582935:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608064 00000100:00100000:0.0:1789776684.582943:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608064 00000100:00100000:0.0:1789776684.583011:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776684.583021:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449608064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776684.583054:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789776684.583101:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449608064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776684.583108:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789776684.583155:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449608064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776684.592239:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776684.592261:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449608192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776684.592337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776684.592525:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608192 00000100:00100000:3.0:1789776684.592534:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608192 00000100:00100000:3.0:1789776684.592592:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776684.592602:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449608192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776684.592639:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789776684.592686:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449608192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776684.592694:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776684.592832:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449608192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789776685.090871:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789776685.093607:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776685.093614:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776685.093617:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776685.093620:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776685.093644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776685.093648:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776685.093650:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776685.093653:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789776685.093703:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449608320:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.093776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.093815:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449608832:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.093841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.093866:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776685.093872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449608448:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.093897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.093915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449608960:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.093965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.094001:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449608576:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.094024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.094040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449609088:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.094080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.094099:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776685.094104:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449608704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776685.094125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776685.094152:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608320 00000100:00100000:1.0:1789776685.094159:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608320 00000100:00100000:2.0:1789776685.094757:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608832 00000100:00100000:2.0:1789776685.094768:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608832 00000100:00100000:2.0:1789776685.094808:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608960 00000100:00100000:2.0:1789776685.094812:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608960 00000100:00100000:2.0:1789776685.094837:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608576 00000100:00100000:2.0:1789776685.094839:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608576 00000100:00100000:2.0:1789776685.094849:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609088 00000100:00100000:2.0:1789776685.094851:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609088 00000100:00100000:2.0:1789776685.094867:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776685.094875:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449608832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.094963:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449608832:12345-0@lo:400:kworker.0 Request processed in 88us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.094970:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776685.094986:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776685.094993:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449608960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095022:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449608960:12345-0@lo:400:kworker.0 Request processed in 30us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095026:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776685.095036:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776685.095041:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449608576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095280:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449608576:12345-0@lo:400:kworker.0 Request processed in 238us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095286:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776685.095300:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776685.095307:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449609088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095336:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449609088:12345-0@lo:400:kworker.0 Request processed in 30us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095342:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776685.095364:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608448 00000100:00100000:2.0:1789776685.095373:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608448 00000100:00100000:2.0:1789776685.095396:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449608704 00000100:00100000:2.0:1789776685.095398:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449608704 00000100:00100000:2.0:1789776685.095411:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776685.095416:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449608448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095445:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449608448:12345-0@lo:400:kworker.0 Request processed in 30us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095451:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776685.095462:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776685.095467:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449608704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095513:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449608704:12345-0@lo:400:kworker.0 Request processed in 45us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095519:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776685.095541:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776685.095548:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:3643:x1876716449608320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095577:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:3643:x1876716449608320:12345-0@lo:400:kworker.0 Request processed in 30us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.095582:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776685.095636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449608704:0@lo:400:kworker.0 00010000:00080000:2.0:1789776685.095651:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff35c700 x1876716449608576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776685.095661:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449608576:0@lo:400:kworker.0 00010000:00080000:2.0:1789776685.095675:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff35d180 x1876716449609088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776685.095684:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449609088:0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095723:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449608448:0@lo:400:kworker.0 00010000:00080000:2.0:1789776685.095737:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff35ea00 x1876716449608960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776685.095745:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449608960:0@lo:400:kworker.0 00000100:00100000:2.0:1789776685.095752:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449608320:0@lo:400:kworker.0 00010000:00080000:2.0:1789776685.095760:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cff35d500 x1876716449608832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776685.095769:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449608832:0@lo:400:kworker.0 00000100:00080000:2.0:1789776685.095807:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789776685.095811:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776686.115623:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776686.623680:0:19063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1789776686.627138:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776687.140807:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789776687.460048:0:19115:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789776687.460260:0:19115:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789776688.162786:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789776688.380277:0:19165:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789776688.380578:0:19165:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789776688.994654:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776673/real 1789776673] req@ffff8a5cff49b800 x1876716449601280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.994689:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff49b800 x1876716449601280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.994699:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776673/real 1789776673] req@ffff8a5cff499180 x1876716449601408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.994710:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff499180 x1876716449601408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776688.994730:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3c84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776688.994758:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776688.994762:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449601280:0@lo:8:kworker.0 00000100:00080000:2.0:1789776688.994807:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776688.994814:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776688.994817:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449601408:0@lo:8:kworker.0 00000100:00080000:1.0:1789776688.995072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776688.995076:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776688.995078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776688.995087:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776688.995104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776688.995107:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789776688.995110:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3c84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776688.995115:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1789776688.995119:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789776688.995126:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a5bc3c84000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776688.995146:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3edca80 x1876716449609728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776688.995157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776688.995160:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789776688.995161:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776688.995164:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1789776688.995166:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789776688.995169:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776688.995179:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3edd880 x1876716449609856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776688.995219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449609472:0@lo:400:kworker.0 00000100:00100000:1.0:1789776688.995284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776688.995335:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449610240:0@lo:400:kworker.0 00000100:00100000:1.0:1789776688.995356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776688.995375:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789776688.995381:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449609344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776688.995405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776688.995433:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449610112:0@lo:400:kworker.0 00000100:00100000:1.0:1789776688.995454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776688.995545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449609600:0@lo:400:kworker.0 00000100:00100000:3.0:1789776688.995574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776688.995591:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789776688.995596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449609216:0@lo:400:kworker.0 00000100:00100000:3.0:1789776688.995619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776688.995636:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449609984:0@lo:400:kworker.0 00000100:00100000:3.0:1789776688.995656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776688.995730:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609472 00000100:00100000:2.0:1789776688.995738:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609472 00000100:00100000:2.0:1789776688.995772:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610240 00000100:00100000:2.0:1789776688.995774:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610240 00000100:00100000:2.0:1789776688.995810:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610112 00000100:00100000:2.0:1789776688.995813:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610112 00000100:00100000:2.0:1789776688.995825:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609984 00000100:00100000:2.0:1789776688.995827:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609984 00000100:00100000:2.0:1789776688.995840:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776688.995850:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.995913:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449609472:12345-0@lo:400:kworker.0 Request processed in 64us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.995920:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776688.995936:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776688.995942:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449610240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.995969:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449610240:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.995975:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776688.995986:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776688.995992:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996019:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876716449610112:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.996024:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776688.996041:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776688.996047:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996077:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449609984:12345-0@lo:400:kworker.0 Request processed in 30us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.996081:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776688.996101:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609344 00000100:00100000:2.0:1789776688.996104:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609344 00000100:00100000:2.0:1789776688.996123:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609600 00000100:00100000:2.0:1789776688.996125:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609600 00000100:00100000:2.0:1789776688.996137:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776688.996143:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449609344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996171:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449609344:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.996177:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776688.996187:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789776688.996192:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449609600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996215:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449609600:12345-0@lo:400:kworker.0 Request processed in 22us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776688.996221:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789776688.996261:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edd500 x1876716449609984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.996275:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449609984:0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449609600:0@lo:400:kworker.0 00000100:00100000:2.0:1789776688.996310:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449609728:0@lo:8:kworker.0 00000100:00100000:2.0:1789776688.996337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776688.996362:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449609856:0@lo:8:kworker.0 00000100:00100000:2.0:1789776688.996384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776688.996415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449609344:0@lo:400:kworker.0 00010000:00080000:2.0:1789776688.996425:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edf480 x1876716449610112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.996434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876716449610112:0@lo:400:kworker.0 00010000:00080000:2.0:1789776688.996443:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3ede680 x1876716449609472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.996451:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449609472:0@lo:400:kworker.0 00010000:00080000:2.0:1789776688.996460:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3eddc00 x1876716449610240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776688.996468:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449610240:0@lo:400:kworker.0 00000100:00080000:3.0:1789776688.996664:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776688.996670:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776688.996687:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609728 00000100:00100000:3.0:1789776688.996691:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609728 00000100:00100000:3.0:1789776688.996707:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609856 00000100:00100000:3.0:1789776688.996709:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609856 00000100:00100000:3.0:1789776688.996719:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776688.996724:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449609728:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789776688.996754:0:18695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1789776688.996781:0:18695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885d76 00002000:00100000:3.0:1789776688.996796:0:18695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a5cf5149000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789776688.996800:0:18695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789776688.996803:0:18695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789776688.996998:0:18695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789776688.997021:0:18695:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776688.997062:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449609728:12345-0@lo:8:kworker.0 Request processed in 337us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776688.997069:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776688.997084:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776688.997088:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449609856:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789776688.997099:0:18695:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789776688.999881:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449609216 00000100:00100000:1.0:1789776688.999897:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449609216 00000100:00100000:1.0:1789776688.999961:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776688.999971:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:3645:x1876716449609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776689.000062:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:3645:x1876716449609216:12345-0@lo:400:kworker.0 Request processed in 92us (4440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776689.000069:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776689.000139:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449609216:0@lo:400:kworker.0 00010000:00080000:2.0:1789776689.000411:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edca80 x1876716449609728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776689.000423:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776689.000432:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789776689.000441:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776689.000446:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789776689.000449:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3c84000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776689.000473:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776689.000478:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449609728:0@lo:8:kworker.0 00000004:00080000:1.0:1789776689.000707:0:17932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789776689.000729:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610496:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789776689.000771:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776689.000793:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9351f00 going to sleep for 11 seconds 00000004:00080000:0.0:1789776689.000956:0:17931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789776689.001047:0:17931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 510245553428ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789776689.001053:0:17931:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789776689.001290:0:18697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789776689.001298:0:18697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789776689.001345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449610368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776689.001378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776689.006048:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610496 00000100:00100000:1.0:1789776689.006062:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610496 00000100:00100000:1.0:1789776689.006131:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776689.006141:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17932:x1876716449610496:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1789776689.006737:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776689.008602:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610368 00000100:00100000:1.0:1789776689.008615:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610368 00000100:00100000:1.0:1789776689.008679:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776689.008691:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876716449610368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776689.008723:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776689.008855:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876716449610368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (7476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776689.009616:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1789776689.009758:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:2.0:1789776689.010666:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edfb80 x1876716449610368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776689.010690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449610368:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1789776689.016267:0:18697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789776689.016280:0:18697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789776689.016391:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17932:x1876716449610496:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10246us (15614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776689.016403:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789776689.016436:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3ede300 x1876716449610496/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776705 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776689.016453:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610496:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789776689.016467:0:17932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789776689.016529:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610624:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789776689.016582:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776689.016614:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776689.016621:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610624 00000100:00100000:1.0:1789776689.016629:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610624 00000100:00100000:1.0:1789776689.016674:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776689.016684:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17932:x1876716449610624:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789776689.016713:0:19184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789776689.016750:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17932:x1876716449610624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776689.016756:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789776689.017294:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0ad80 x1876716449610624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776705 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776689.017306:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610624:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789776689.017316:0:17932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789776689.017348:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610752:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789776689.017376:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776689.017405:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776689.017420:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610752 00000100:00100000:1.0:1789776689.017426:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610752 00000100:00100000:1.0:1789776689.017457:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776689.017464:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17932:x1876716449610752:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789776689.017523:0:18697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789776689.022783:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449609856:12345-0@lo:8:kworker.0 Request processed in 25685us (26390us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789776689.022936:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789776689.023222:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776689.023228:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789776689.023232:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449609856:0@lo:8:kworker.0 00000001:00080000:3.0:1789776689.079110:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789776689.079125:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789776689.079374:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17932:x1876716449610752:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61905us (61992us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789776689.079385:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789776689.079576:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0ad80 x1876716449610752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776705 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776689.079589:0:17932:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789776689.079595:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876716449610752:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789776689.079608:0:17932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789776689.079669:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17932:1876716449610880:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789776689.079703:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776689.079729:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd9a23780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776689.080404:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449610880 00000100:00100000:2.0:1789776689.080411:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449610880 00000100:00100000:2.0:1789776689.080453:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776689.080462:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17932:x1876716449610880:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789776689.080602:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17932:x1876716449610880:12345-0@lo:900:osp-pre-0-1.0 Request processed in 140us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776689.080609:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789776689.080959:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0ad80 x1876716449610880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776705 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776689.080971:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17932:1876716449610880:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789776689.187281:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776689.698895:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776689.698920:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449611008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776689.699018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776689.699107:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611008 00000100:00100000:2.0:1789776689.699116:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611008 00000100:00100000:2.0:1789776689.699175:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789776689.699185:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449611008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789776689.699224:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789776689.699269:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449611008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776689.699276:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776689.699425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449611008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776689.701227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776689.701246:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449611136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776689.701320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776689.701368:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611136 00000100:00100000:3.0:1789776689.701374:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611136 00000100:00100000:3.0:1789776689.701418:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776689.701427:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449611136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776689.701461:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789776689.701525:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449611136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776689.701533:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776689.701572:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449611136:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789776690.211167:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776691.234885:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776692.259679:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776692.707153:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776693.283720:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776694.306684:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776694.306807:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776694.306829:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449611264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789776694.306900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.306987:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611264 00000100:00100000:0.0:1789776694.306994:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611264 00000100:00100000:0.0:1789776694.307047:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776694.307057:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449611264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776694.307096:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789776694.307142:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449611264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776694.307150:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789776694.307170:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776694.307198:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e09c00 x1876716449611264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776694.307215:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449611264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789776694.308147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776694.308152:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776694.308154:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776694.308157:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789776694.308180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776694.308183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776694.308186:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776694.308192:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1789776694.308197:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789776694.308203:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776694.308223:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cf5e09500 x1876716449611904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776694.308269:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449611392:0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.308342:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449612032:0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.308405:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776694.308411:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449611520:0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.308453:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449612160:0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.308531:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449611904:0@lo:8:kworker.0 00000100:00100000:0.0:1789776694.308557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776694.308587:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612032 00000100:00100000:0.0:1789776694.308594:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612032 00000100:00100000:0.0:1789776694.308628:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612160 00000100:00100000:0.0:1789776694.308631:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612160 00000100:00100000:0.0:1789776694.308660:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776694.308668:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449612032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308707:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449612032:12345-0@lo:400:kworker.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776694.308714:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776694.308726:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776694.308731:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449612160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.308757:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449612160:12345-0@lo:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776694.308762:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776694.308896:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611392 00000100:00100000:1.0:1789776694.308900:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611392 00000100:00100000:1.0:1789776694.308947:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789776694.308954:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:3645:x1876716449611392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.308995:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+21:3645:x1876716449611392:12345-0@lo:400:kworker.0 Request processed in 42us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.309001:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789776694.309324:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611520 00000100:00100000:0.0:1789776694.309329:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611520 00000100:00100000:0.0:1789776694.309365:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776694.309372:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449611520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.309418:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449611520:12345-0@lo:400:kworker.0 Request processed in 46us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776694.309423:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776694.309465:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611904 00000100:00100000:0.0:1789776694.309469:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611904 00000100:00100000:0.0:1789776694.309513:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776694.309518:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449611904:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789776694.309536:0:18698:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789776694.315946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449611776:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776694.316067:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789776694.316073:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449611648:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776694.316110:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776694.316154:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611776 00000100:00100000:1.0:1789776694.316160:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611776 00000100:00100000:1.0:1789776694.316203:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776694.316212:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449611776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316265:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449611776:12345-0@lo:400:kworker.0 Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.316273:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776694.316295:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449611648 00000100:00100000:1.0:1789776694.316299:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449611648 00000100:00100000:1.0:1789776694.316319:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612288 00000100:00100000:1.0:1789776694.316321:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612288 00000100:00100000:1.0:1789776694.316337:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776694.316342:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449611648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316367:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449611648:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.316372:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776694.316396:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789776694.316401:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316423:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876716449612288:12345-0@lo:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.316428:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789776694.316443:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776694.316446:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776694.316472:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e09180 x1876716449611648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776694.316486:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449611648:0@lo:400:kworker.0 00010000:00080000:1.0:1789776694.316512:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e08e00 x1876716449612288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776694.316520:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876716449612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.316529:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449611776:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.325950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449611520:0@lo:400:kworker.0 00010000:00080000:1.0:1789776694.325977:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e09880 x1876716449612160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776694.325988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449612160:0@lo:400:kworker.0 00000100:00100000:1.0:1789776694.325999:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449611392:0@lo:400:kworker.0 00010000:00080000:1.0:1789776694.326010:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0a300 x1876716449612032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776694.326018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449612032:0@lo:400:kworker.0 00000100:00100000:0.0:1789776694.330453:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449611904:12345-0@lo:8:kworker.0 Request processed in 20925us (21887us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789776694.330468:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789776694.331958:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776694.331970:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776694.331975:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449611904:0@lo:8:kworker.0 00000100:00100000:1.0:1789776694.822564:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449612416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789776694.822600:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449612544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776694.822640:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776694.831406:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612416 00000100:00100000:1.0:1789776694.831421:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612416 00000100:00100000:1.0:1789776694.831472:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776694.831482:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449612416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776694.831539:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789776694.831612:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449612416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (8972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.831619:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776694.831669:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449612416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776694.831826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776694.831894:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612544 00000100:00100000:1.0:1789776694.831899:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612544 00000100:00100000:1.0:1789776694.831962:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789776694.831970:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449612544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776694.831988:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789776694.832032:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449612544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776694.832038:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776694.832093:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449612544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789776695.331269:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776695.343206:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776675/real 1789776675] req@ffff8a5cff499f80 x1876716449603456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776695 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.344182:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5cff499f80 x1876716449603456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776695 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.344205:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776675/real 1789776675] req@ffff8a5bc3e90000 x1876716449602944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776695 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.344329:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a5bc3e90000 x1876716449602944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776695 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789776695.344350:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776695.344374:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789776695.344378:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449603456:0@lo:8:kworker.0 00000100:00080000:1.0:1789776695.344384:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776695.344389:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789776695.344392:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449602944:0@lo:8:kworker.0 00000100:00080000:1.0:1789776695.346371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776695.346378:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789776695.346381:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776695.346389:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1789776695.346394:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789776695.346400:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a5cfaf0e000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776695.346427:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3ede680 x1876716449612800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776695.346441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776695.346444:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789776695.346445:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776695.346448:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1789776695.346450:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789776695.346464:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776695.346477:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3edf480 x1876716449612928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776695.346779:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776695.346783:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789776695.346785:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776695.346789:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1789776695.346792:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789776695.346796:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1789776695.346808:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3edd500 x1876716449613312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776695.346855:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:086c90d1-9383-41b8-afea-b47b6abf291d:3646:1876716449612672:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.346925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347034:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449613568:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.347068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347095:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776695.347102:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449613440:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.347125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347155:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449612800:0@lo:8:kworker.0 00000100:00100000:1.0:1789776695.347183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347201:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449612928:0@lo:8:kworker.0 00000100:00100000:1.0:1789776695.347276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347297:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449613312:0@lo:8:kworker.0 00000100:00100000:1.0:1789776695.347321:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776695.347443:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612800 00000100:00100000:1.0:1789776695.347445:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449613056:0@lo:400:kworker.0 00000100:00100000:2.0:1789776695.347453:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612800 00000100:00100000:1.0:1789776695.347477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776695.347485:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612928 00000100:00100000:2.0:1789776695.347512:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612928 00000100:00100000:2.0:1789776695.347523:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613312 00000100:00100000:2.0:1789776695.347526:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613312 00000100:00100000:2.0:1789776695.347538:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776695.347545:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449612800:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789776695.347574:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1789776695.347617:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885d7d 00002000:00100000:2.0:1789776695.347632:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a5bc2467800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789776695.347636:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789776695.347639:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789776695.347796:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449613696:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.347821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347839:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776695.347845:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449613184:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.347865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.347889:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449612672 00000100:00100000:1.0:1789776695.347893:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449612672 00000100:00100000:1.0:1789776695.347926:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789776695.347933:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:3646:x1876716449612672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.348051:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:3646:x1876716449612672:12345-0@lo:400:kworker.0 Request processed in 118us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776695.348059:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789776695.348095:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613568 00000100:00100000:1.0:1789776695.348100:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613568 00000100:00100000:1.0:1789776695.348124:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613440 00000100:00100000:1.0:1789776695.348127:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613440 00000100:00100000:1.0:1789776695.348140:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613056 00000100:00100000:1.0:1789776695.348142:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613056 00000100:00100000:1.0:1789776695.348154:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613696 00000100:00100000:1.0:1789776695.348157:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613696 00000100:00100000:1.0:1789776695.348170:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776695.348176:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449613568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.348209:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449613568:12345-0@lo:400:kworker.0 Request processed in 33us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776695.348275:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776695.348288:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776695.348303:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449613440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.348339:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449613440:12345-0@lo:400:kworker.0 Request processed in 37us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776695.348346:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00002000:00080000:2.0:1789776695.348354:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789776695.348361:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776695.348369:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449613056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789776695.348386:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8a5bc2460000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776695.348406:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449613056:12345-0@lo:400:kworker.0 Request processed in 38us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776695.348412:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776695.348424:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776695.348431:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449613696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776695.348443:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449612800:12345-0@lo:8:kworker.0 Request processed in 896us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776695.348452:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776695.348467:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449613696:12345-0@lo:400:kworker.0 Request processed in 36us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776695.348470:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613184 00000100:00100000:2.0:1789776695.348475:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613184 00000100:00100000:1.0:1789776695.348475:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776695.348518:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776695.348525:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449613184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776695.348555:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449613184:12345-0@lo:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776695.348560:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776695.348572:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776695.348576:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449612928:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789776695.348590:0:18698:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789776695.348632:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449612928:12345-0@lo:8:kworker.0 Request processed in 54us (1355us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776695.348645:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776695.348657:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776695.348661:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449613312:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789776695.348670:0:18698:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789776695.348764:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edfb80 x1876716449613440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449613440:0@lo:400:kworker.0 00000100:00100000:1.0:1789776695.348791:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:086c90d1-9383-41b8-afea-b47b6abf291d:3646:1876716449612672:0@lo:400:kworker.0 00010000:00080000:1.0:1789776695.348801:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e09500 x1876716449613568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348809:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449613568:0@lo:400:kworker.0 00010000:00080000:1.0:1789776695.348842:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edea00 x1876716449613184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348862:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449613184:0@lo:400:kworker.0 00010000:00080000:1.0:1789776695.348875:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3edf800 x1876716449613056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348883:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449613056:0@lo:400:kworker.0 00010000:00080000:1.0:1789776695.348892:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5cf5e0a300 x1876716449613696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348900:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449613696:0@lo:400:kworker.0 00010000:00080000:1.0:1789776695.348927:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3ede680 x1876716449612800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.348935:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776695.348942:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789776695.349021:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789776695.349027:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789776695.349030:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789776695.349046:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789776695.349052:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449612800:0@lo:8:kworker.0 00000100:00080000:1.0:1789776695.349067:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776695.349072:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776695.349076:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449612928:0@lo:8:kworker.0 00000004:00080000:1.0:1789776695.349100:0:17214:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789776695.349178:0:17214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 516593683855ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789776695.349185:0:17214:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789776695.349323:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876716449613312:12345-0@lo:8:kworker.0 Request processed in 659us (2000us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776695.349330:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789776695.349367:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776695.349378:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789776695.349381:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449613312:0@lo:8:kworker.0 00000004:00080000:2.0:1789776695.349550:0:17215:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789776695.349568:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17215:1876716449613952:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789776695.349599:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776695.349756:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449613824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776695.350016:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce0162c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776695.350034:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613952 00000100:00100000:1.0:1789776695.350039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776695.350041:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613952 00000100:00100000:2.0:1789776695.350083:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776695.350090:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17215:x1876716449613952:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789776695.350168:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449613824 00000100:00100000:1.0:1789776695.350173:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449613824 00000100:00100000:1.0:1789776695.350207:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776695.350274:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449613824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776695.350289:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776695.350330:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876716449613824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776695.350337:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789776695.350354:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789776695.350417:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a5bc3e93480 x1876716449613824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776695.350432:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449613824:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789776695.351251:0:17170:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789776695.355603:0:18695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789776695.355991:0:18695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789776695.355999:0:18695:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:0.0:1789776695.399601:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789776695.399619:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.399639:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1789776695.399644:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776695.399650:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.399668:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.400818:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.400842:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.401291:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776695.401997:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.402008:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.402020:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.402026:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.402038:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.402070:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.402078:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861e10fe/0xf13b8042cb885d84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.402099:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.402101:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.402103:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776695.402896:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789776695.402905:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.403792:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1789776695.403798:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776695.403804:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.403820:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.403832:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.403840:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.403872:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776695.405114:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.405124:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.405137:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdfc00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.405141:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.405152:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.405172:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.405180:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1a52e3/0xf13b8042cb885d8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.405298:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.405301:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.405303:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776695.405902:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789776695.405924:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.405947:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1789776695.405952:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776695.405958:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.405970:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.405980:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.405987:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.406013:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776695.406249:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.406256:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.406264:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.406268:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.406277:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.406290:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.406296:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3decd91/0xf13b8042cb885d92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.406312:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.406314:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.406315:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776695.411368:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.411384:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.411403:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.411408:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.411415:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.411433:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.411455:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.411464:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.411514:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776695.411782:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776695.411790:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.411799:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776695.411804:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.411814:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.411847:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.411855:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a2dc98/0xf13b8042cb885d99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.411882:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.411884:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.411886:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776695.412537:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.412546:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.412558:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.412561:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.412566:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.412575:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.412583:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.412590:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.412622:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776695.413040:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776695.413048:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.413058:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776695.413061:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.413069:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.413082:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.413088:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885da0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.413118:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.413120:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.413121:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776695.413206:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.413226:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413234:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.413237:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.413241:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413250:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413257:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413264:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413320:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789776695.413897:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.413904:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413928:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.413937:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.413942:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413952:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413960:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.413967:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414157:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789776695.414164:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414172:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776695.414175:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414184:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414197:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414204:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885da7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414291:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776695.414295:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414302:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776695.414311:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414319:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414329:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776695.414405:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.414407:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776695.414409:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.415526:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.415538:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885dae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776695.419150:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.419167:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.419186:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.419191:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.419198:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.419212:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.419230:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.419237:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.421608:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.421624:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.421650:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.421655:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.421666:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.421772:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.421788:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.421789:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.421792:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.422024:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.422033:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885db5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.422120:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776695.426861:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.426877:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.426894:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.426899:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.426905:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427006:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427018:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427027:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427104:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776695.427759:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.427767:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427778:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.427782:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.427787:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427796:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427804:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.427824:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428039:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776695.428047:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428055:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.428060:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428070:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428086:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428100:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885dbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428121:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.428124:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428130:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.428133:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428139:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428150:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.428157:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.428159:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.428161:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.428281:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.428286:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885dc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.428893:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.428900:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.428921:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.428926:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.428931:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.428940:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.428949:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.428957:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429066:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.429073:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429080:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.429091:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429100:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429110:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429118:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.429120:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.429122:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.429188:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.429193:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885dca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.429784:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.429791:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.429801:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.429805:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.429810:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.429819:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.429827:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.429834:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429882:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.429888:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429896:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.429900:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429908:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429981:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.429990:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.429997:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.429999:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.430056:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.430061:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295bc711/0xf13b8042cb885dd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.430452:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.430458:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.430467:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.430470:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.430474:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.430483:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.430514:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.430522:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.430768:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.430774:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.430781:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.430785:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.430792:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.430804:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.430812:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.430814:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.430816:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.430876:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.430881:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af3745e9/0xf13b8042cb885dd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.433921:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.433935:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.433965:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.433969:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.433976:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.433989:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.433999:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.434007:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.434562:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.434572:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.434581:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.434586:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.434597:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.434621:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.434630:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.434632:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.434634:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.434821:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.434827:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06ef862/0xf13b8042cb885ddf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.435615:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.435623:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.435635:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.435639:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.435644:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.435667:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.435686:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.435694:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.435819:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.435825:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.435833:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.435837:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.435846:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.435860:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.435868:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.435870:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.435871:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.436049:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.436055:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078920057/0xf13b8042cb885de6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.436542:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.436548:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.436558:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.436561:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.436566:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.436577:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.436597:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.436603:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.436617:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776695.437054:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.437061:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437069:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.437073:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.437077:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437086:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437094:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437101:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437122:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789776695.437488:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.437520:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437530:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.437533:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.437538:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437547:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437556:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437563:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.437573:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789776695.438565:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789776695.438577:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438602:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.438608:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438616:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438635:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438642:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000046b57d4/0xf13b8042cb885ded lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438661:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776695.438665:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438836:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.438842:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438851:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438861:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438874:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f6035d6/0xf13b8042cb885df4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438887:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.438891:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438897:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.438900:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.438908:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776695.439078:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.439086:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.439097:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.439106:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.439112:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.439124:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.439133:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.439140:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.439479:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.439487:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5970261/0xf13b8042cb885dfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.439530:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.439533:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.439535:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.439546:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.439552:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.439660:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776695.440656:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776695.440664:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.440689:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789776695.440693:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776695.440699:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.440710:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.440720:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.440736:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.440988:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776695.441001:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441009:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.441013:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441023:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441037:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441045:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005418c372/0xf13b8042cb885e02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441061:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.441065:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441071:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.441074:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441082:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441105:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.441114:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.441116:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.441118:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.441187:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776695.441193:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a353df7/0xf13b8042cb885e09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776695.442016:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.442024:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.442034:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.442038:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.442042:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.442051:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.442059:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.442078:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442177:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.442184:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442191:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.442195:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442202:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442277:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442287:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.442289:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.442291:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.442392:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.442397:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d132bb/0xf13b8042cb885e10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.442557:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776695.443019:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.443027:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443036:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.443040:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.443044:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443053:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443060:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443066:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443132:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789776695.443546:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.443552:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443561:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.443565:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.443569:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443578:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443586:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.443593:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.443988:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776695.443996:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444005:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776695.444009:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444018:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444033:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444041:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040519f09/0xf13b8042cb885e17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444058:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776695.444069:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444076:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776695.444079:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444088:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444098:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.444105:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.444106:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.444108:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.444177:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.444183:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006a730a3/0xf13b8042cb885e1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.444770:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776695.445002:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.445010:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445028:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.445031:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.445036:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445045:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445053:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445060:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445110:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789776695.445564:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.445570:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445579:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.445583:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.445587:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445597:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445618:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.445625:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.445935:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776695.445950:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.445958:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.445962:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.445971:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.445988:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.445996:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065cbda55/0xf13b8042cb885e25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.446016:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.446020:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.446026:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.446029:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.446036:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.446058:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.446065:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.446066:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.446068:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.446182:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.446188:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1f95f5/0xf13b8042cb885e2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776695.446819:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.446827:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.446837:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.446841:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.446845:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.446855:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.446863:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.446883:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.446954:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776695.446961:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.446969:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776695.446972:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.446978:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.446990:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776695.447005:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.447006:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776695.447008:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.447124:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.447129:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000545f0e9/0xf13b8042cb885e33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776695.447684:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776695.447691:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.447701:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789776695.447704:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776695.447708:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.447716:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.447730:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776695.447738:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.447887:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776695.447895:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.447902:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776695.447906:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.448083:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.448099:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776695.448108:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.448110:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776695.448111:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776695.448171:0:18695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776695.448176:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f309f411/0xf13b8042cb885e3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789776695.448253:0:18695:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789776695.448462:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17215:x1876716449613952:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98367us (98857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776695.448471:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789776695.448654:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776695.448805:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17215:1876716449613952:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789776695.448824:0:17215:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789776695.448893:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17215:1876716449614080:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789776695.449012:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776695.449077:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc651a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776695.449121:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614080 00000100:00100000:3.0:1789776695.449128:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614080 00000100:00100000:3.0:1789776695.449218:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776695.449228:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17215:x1876716449614080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789776695.449267:0:18698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1789776695.461315:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789776695.461430:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789776695.464027:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17215:x1876716449614080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14790us (15003us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789776695.464041:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776695.465017:0:17215:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789776695.465029:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17215:1876716449614080:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789776695.465048:0:17215:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:01000004:2.0:1789776696.214046:0:19511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789776696.214051:0:19511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789776696.214053:0:19511:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789776696.214167:0:19511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a5bc2465800 00000020:01000004:2.0:1789776696.214186:0:19511:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789776696.214201:0:19511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789776696.214216:0:19511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a5cfc0d3370) 00000020:00000080:2.0:1789776696.214232:0:19511:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789776696.280641:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789776696.282826:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789776696.283537:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789776696.284386:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789776696.284761:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789776696.285011:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789776696.285489:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789776696.287479:0:19511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789776696.288312:0:19511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789776696.288330:0:19511:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789776696.288352:0:19511:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf13b8042cb885e48 00000020:01000004:2.0:1789776696.288359:0:19511:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789776696.288382:0:19511:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789776696.288386:0:19511:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789776696.288393:0:19511:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789776696.288489:0:19511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789776696.288521:0:19511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789776696.303674:0:19511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789776696.303712:0:19511:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789776696.303716:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789776696.303718:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789776696.303720:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776696.303721:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776696.303722:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776696.303723:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776696.303725:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776696.303739:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776696.303740:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776696.303745:0:19511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789776696.303747:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776696.303749:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789776696.303750:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776696.303751:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776696.303752:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776696.303754:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776696.303755:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776696.303756:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776696.303757:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776696.303784:0:19511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789776696.303805:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789776696.303885:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776696.304013:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cedf0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776696.304269:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614208 00000100:00100000:1.0:1789776696.304276:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614208 00000100:00100000:1.0:1789776696.304371:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789776696.304381:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:19511:x1876716449614208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789776696.304427:0:17184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789776696.304431:0:17184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789776696.304436:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789776696.304824:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:19511:x1876716449614208:12345-0@lo:253:mount.lustre.0 Request processed in 444us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.304833:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789776696.304956:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789776696.304979:0:19511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789776696.304982:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776696.304983:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776696.304985:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776696.304986:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776696.304987:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776696.304988:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776696.304999:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776696.305001:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776696.305002:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776696.305042:0:19511:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a5bc2465800 from lustre-OST0001 10000000:01000000:3.0:1789776696.305070:0:19511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789776696.305073:0:19511:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776696.305082:0:19511:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a5bc273b370 local copy 00010000:00010000:3.0:1789776696.305095:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776696.305580:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776696.305618:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.305811:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776696.305900:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614336 00000100:00100000:2.0:1789776696.305906:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614336 00000100:00100000:1.0:1789776696.306160:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789776696.306169:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:19511:x1876716449614336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776696.306247:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:19511:x1876716449614336:12345-0@lo:501:mount.lustre.0 Request processed in 79us (628us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776696.306254:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789776696.306368:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789776696.306383:0:19511:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789776696.306412:0:19511:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789776696.306420:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.306430:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cdf400/0xf13b8042cb885a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885aa5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776696.306461:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a5bc2465800 10000000:01000000:3.0:1789776696.306467:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789776696.306474:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776696.306477:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789776696.306482:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789776696.306485:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789776696.306538:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.306545:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.306564:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776696.306580:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776696.306607:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.306628:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776696.306780:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614464 00000100:00100000:1.0:1789776696.306785:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614464 00000100:00100000:1.0:1789776696.306814:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789776696.306821:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:19511:x1876716449614464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776696.306829:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776696.306842:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb885e56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885e4f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.306864:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb885e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885e4f expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.306874:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c0600/0xf13b8042cb885e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885e4f expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.306904:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0600, rc 0) 00000100:00100000:1.0:1789776696.306940:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614464:12345-0@lo:101:mount.lustre.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.306945:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789776696.307317:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776696.307333:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e56 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.307342:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885e56 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776696.309954:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789776696.311322:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776696.316484:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789776696.316641:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789776696.316656:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789776696.316669:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789776696.316683:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789776696.316694:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789776696.316717:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789776696.316723:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789776696.316839:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776696.317014:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776696.317118:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614592 00000100:00100000:2.0:1789776696.317137:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614592 00000100:00100000:2.0:1789776696.317186:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789776696.317195:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776696.317365:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614592:12345-0@lo:501:mount.lustre.0 Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.317373:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789776696.318387:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776696.318420:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776696.318480:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776696.318621:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.318685:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776696.318721:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614720 00000100:00100000:2.0:1789776696.318735:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614720 00000100:00100000:2.0:1789776696.318810:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789776696.318818:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776696.319938:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614720:12345-0@lo:503:mount.lustre.0 Request processed in 1114us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.319951:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776696.320376:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789776696.321177:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776696.321259:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776696.321312:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.321351:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776696.321377:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614848 00000100:00100000:1.0:1789776696.321384:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614848 00000100:00100000:1.0:1789776696.321480:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789776696.321725:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776696.322908:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614848:12345-0@lo:502:mount.lustre.0 Request processed in 1402us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.322920:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789776696.323249:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776696.323577:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789776696.323612:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789776696.323628:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789776696.323640:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789776696.323651:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789776696.323663:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789776696.323695:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789776696.323710:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789776696.323722:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789776696.323774:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776696.323832:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.323871:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776696.324466:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449614976 00000100:00100000:2.0:1789776696.324475:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449614976 00000100:00100000:2.0:1789776696.324553:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789776696.324565:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776696.324801:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449614976:12345-0@lo:502:mount.lustre.0 Request processed in 238us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.324808:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776696.325318:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449614976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776696.325399:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789776696.325413:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789776696.326593:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789776696.326604:0:19515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789776696.326611:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.326614:0:19515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789776696.326620:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776696.326636:0:19515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a5cff3b3370) 00000020:00000080:3.0:1789776696.326671:0:19515:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789776696.326678:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789776696.326811:0:19515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc2465800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789776696.326819:0:19515:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789776696.326827:0:19515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf13b8042cb885e64 00010000:00010000:3.0:1789776696.333316:0:19515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789776696.333986:0:19515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789776696.336053:0:19515:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789776696.337907:0:19515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789776696.337921:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776696.337927:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.337929:0:19515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789776696.337932:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776696.337937:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.337938:0:19515:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776696.337941:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776696.337943:0:19515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789776696.337945:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776696.337947:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.337948:0:19515:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789776696.337950:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776696.337953:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.337954:0:19515:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789776696.337957:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789776696.338006:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776696.338009:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776696.338010:0:19515:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789776696.338014:0:19515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789776696.338228:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789776696.338258:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789776696.338288:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e56 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338301:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257000/0xf13b8042cb885e4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e56 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776696.338310:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc2465800 from 1 10000000:01000000:1.0:1789776696.338313:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776696.338351:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338369:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338381:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776696.338407:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776696.338477:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.338536:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615104 00000100:00100000:1.0:1789776696.338543:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615104 00000100:00100000:1.0:1789776696.338583:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789776696.338590:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:19511:x1876716449615104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776696.338603:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776696.338615:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885e6b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338639:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338649:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338657:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776696.338688:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615104:12345-0@lo:101:mount.lustre.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.338694:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789776696.338752:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776696.338777:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776696.338791:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.338800:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776696.350836:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789776696.352686:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776696.353637:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789776696.353678:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789776696.353704:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789776696.353712:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789776696.354225:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776696.354639:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776696.354695:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776696.354839:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615232 00000100:00100000:0.0:1789776696.354847:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615232 00000100:00100000:0.0:1789776696.354914:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789776696.354924:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776696.355065:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615232:12345-0@lo:501:mount.lustre.0 Request processed in 142us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.355073:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789776696.355628:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776696.355680:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776696.355751:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776696.355964:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615360 00000100:00100000:2.0:1789776696.355971:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615360 00000100:00100000:2.0:1789776696.356286:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789776696.356296:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776696.356410:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615360:12345-0@lo:503:mount.lustre.0 Request processed in 114us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.356418:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789776696.356596:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cd98f7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776696.356619:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789776696.357367:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776696.357451:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776696.357537:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.357686:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776696.357737:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615488 00000100:00100000:0.0:1789776696.357745:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615488 00000100:00100000:0.0:1789776696.357779:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789776696.357786:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776696.357884:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615488:12345-0@lo:502:mount.lustre.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776696.358000:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776696.358211:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789776696.358238:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789776696.358255:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789776696.358268:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789776696.358281:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789776696.358296:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789776696.358307:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789776696.358319:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789776696.358332:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789776696.358344:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789776696.358358:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789776696.358385:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776696.358425:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.358436:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8fbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776696.358810:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789776696.358853:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615616 00000100:00100000:0.0:1789776696.358858:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615616 00000100:00100000:0.0:1789776696.358880:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789776696.358887:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776696.359129:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776696.359180:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789776696.359190:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:0.0:1789776696.359668:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615616:12345-0@lo:502:mount.lustre.0 Request processed in 102us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.359677:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:0.0:1789776696.359922:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789776696.360416:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776696.360425:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360428:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789776696.360435:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc2465800 00000020:00000080:2.0:1789776696.360438:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776696.360447:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776696.360450:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360452:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789776696.360455:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776696.360457:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360458:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776696.360461:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a5bc2465800 00000020:00000080:2.0:1789776696.360463:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776696.360605:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776696.360609:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360610:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789776696.360613:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776696.360616:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360617:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776696.360621:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc2465800 00000020:00000080:2.0:1789776696.360623:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776696.360640:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776696.360652:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360654:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776696.360657:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776696.360660:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360661:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789776696.360664:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a5bc2465800 00000020:00000080:2.0:1789776696.360666:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789776696.360688:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776696.360691:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776696.360692:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789776696.360695:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789776696.363268:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789776696.363317:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776696.365103:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.365129:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776696.365212:0:19511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789776696.365215:0:19511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a5bc2465800 10000000:01000000:1.0:1789776696.365218:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a5bc2465800 10000000:01000000:1.0:1789776696.365223:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776696.365229:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a5bc2465800 from 1 10000000:01000000:1.0:1789776696.365232:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776696.365273:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.365281:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.365292:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776696.365317:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789776696.365399:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.365452:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776696.365815:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615744 00000100:00100000:3.0:1789776696.365823:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615744 00000100:00100000:3.0:1789776696.365877:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789776696.365902:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:19511:x1876716449615744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776696.365923:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776696.365938:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cfc256000/0xf13b8042cb885e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885e79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.365964:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cfc256000/0xf13b8042cb885e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885e79 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.365974:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cfc256000/0xf13b8042cb885e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885e79 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.365982:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256000, rc 0) 00000100:00100000:3.0:1789776696.366035:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449615744:12345-0@lo:101:mount.lustre.0 Request processed in 149us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776696.366042:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789776696.366429:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776696.366445:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e80 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.366454:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885e80 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776696.368275:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789776696.368586:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776696.368801:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789776696.368827:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789776696.368842:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789776696.368856:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789776696.368871:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789776696.368885:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789776696.368899:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789776696.368927:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789776696.368942:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789776696.368955:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789776696.368969:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789776696.369233:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789776696.369250:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789776696.369261:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789776696.369273:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789776696.369287:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789776696.369301:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789776696.369314:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789776696.369327:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789776696.369340:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789776696.369365:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789776696.369379:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789776696.369392:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789776696.369406:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789776696.369420:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789776696.369434:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789776696.369447:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789776696.369474:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789776696.369643:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789776696.369670:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789776696.369685:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789776696.369698:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789776696.369710:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789776696.369722:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789776696.369749:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789776696.369760:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789776696.369771:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789776696.369782:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789776696.369793:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789776696.369806:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789776696.369819:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789776696.369830:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789776696.369840:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789776696.369868:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789776696.369884:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789776696.369894:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789776696.369913:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789776696.369918:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789776696.376892:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776696.376974:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.377263:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776696.377327:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449615872 00000100:00100000:3.0:1789776696.377337:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449615872 00000100:00100000:3.0:1789776696.377398:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789776696.377409:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449615872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776696.377598:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449615872:12345-0@lo:501:mount.lustre.0 Request processed in 191us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776696.377607:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776696.379294:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449615872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776696.379369:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776696.379437:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.379476:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776696.379551:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616000 00000100:00100000:0.0:1789776696.379559:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616000 00000100:00100000:0.0:1789776696.379632:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789776696.379645:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789776696.379800:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616000:12345-0@lo:503:mount.lustre.0 Request processed in 158us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.379808:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776696.380242:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789776696.382675:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776696.382794:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776696.382878:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.382934:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776696.384625:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616128 00000100:00100000:2.0:1789776696.384640:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616128 00000100:00100000:2.0:1789776696.384694:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776696.384704:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776696.384872:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616128:12345-0@lo:502:mount.lustre.0 Request processed in 168us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.384879:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789776696.387568:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776696.387858:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789776696.387907:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789776696.387923:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789776696.387934:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789776696.387947:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789776696.387958:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789776696.387972:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789776696.387985:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789776696.388454:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789776696.388472:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789776696.389079:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789776696.390080:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789776696.390216:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789776696.390239:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789776696.390256:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789776696.390274:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789776696.390288:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789776696.390301:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789776696.390313:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789776696.390340:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789776696.390354:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789776696.390367:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789776696.390382:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789776696.390396:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789776696.390409:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789776696.390424:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789776696.390453:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789776696.390471:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789776696.390488:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789776696.390536:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789776696.390553:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789776696.390568:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789776696.390582:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789776696.390596:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789776696.390611:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789776696.390626:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789776696.390640:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789776696.390652:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789776696.390665:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789776696.390677:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789776696.390690:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789776696.390704:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789776696.390746:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789776696.390764:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789776696.390777:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789776696.390787:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789776696.390799:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789776696.390814:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789776696.390875:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776696.390961:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.392660:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616256 00000100:00100000:3.0:1789776696.392674:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616256 00000100:00100000:3.0:1789776696.392765:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776696.392776:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776696.394180:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776696.394299:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616256:12345-0@lo:502:mount.lustre.0 Request processed in 1520us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776696.394318:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789776696.394418:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776696.394689:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789776696.394719:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789776696.394775:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776696.394828:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.394870:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776696.394883:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616384 00000100:00100000:0.0:1789776696.394890:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616384 00000100:00100000:0.0:1789776696.394939:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789776696.394949:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776696.395323:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449616384:12345-0@lo:502:mount.lustre.0 Request processed in 376us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.395331:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789776696.395370:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449616384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776696.395420:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789776696.395430:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789776696.403397:0:19524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789776696.403414:0:19524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a5cfaf2b370) 00000020:00000080:3.0:1789776696.403442:0:19524:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789776696.403547:0:19524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc2465800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776696.403551:0:19524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc2465800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776696.403554:0:19524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc2465800 3 00010000:00080000:3.0:1789776696.403586:0:19524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5bc3d5e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1789776696.409366:0:19524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789776696.413396:0:19524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789776696.413471:0:19524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776696.413486:0:19524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf13b8042cb885e8e 00000100:00080000:2.0:1789776696.413531:0:19524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776696.413538:0:19524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a5bc3d5e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1789776696.413588:0:19524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5bc3e93480 x1876716449616512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776696.413627:0:19524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789776696.413825:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449616512:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789776696.414335:0:19524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789776696.414353:0:19524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a5cfaf28000) 00000020:00000080:3.0:1789776696.414373:0:19524:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789776696.414465:0:19524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a5bc2465800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776696.414470:0:19524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a5bc2465800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789776696.414473:0:19524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a5bc2465800 3 00010000:00080000:3.0:1789776696.414523:0:19524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a5cf514c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:0.0:1789776696.414733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776696.414834:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776696.414838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776696.414841:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776696.414847:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1789776696.414850:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789776696.414854:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776696.414871:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cff349f80 x1876716449616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776696.415064:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616512 00000100:00100000:1.0:1789776696.415072:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616512 00000100:00100000:1.0:1789776696.415105:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789776696.415288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776696.415291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776696.415293:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776696.415298:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1789776696.415300:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789776696.415304:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776696.415316:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cd8827100 x1876716449617408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776696.415382:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449616896:0@lo:8:kworker.0 00000100:00100000:0.0:1789776696.415432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776696.415455:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449617408:0@lo:8:kworker.0 00000100:00100000:0.0:1789776696.415474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.415737:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876716449616512:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789776696.415769:0:17190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1789776696.415811:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf13b8042cb885e9c 00000004:00100000:1.0:1789776696.415829:0:17190:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789776696.415868:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8a5cc91fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776696.416088:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616896 00000100:00100000:3.0:1789776696.416094:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616896 00000100:00100000:3.0:1789776696.416135:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617408 00000100:00100000:3.0:1789776696.416138:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617408 00000100:00100000:3.0:1789776696.416156:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776696.416161:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449616896:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789776696.416217:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449616896:12345-0@lo:8:kworker.0 Request processed in 54us (783us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789776696.416225:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776696.416240:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776696.416243:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449617408:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789776696.416267:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876716449617408:12345-0@lo:8:kworker.0 Request processed in 23us (793us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789776696.416283:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776696.416325:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776696.416332:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776696.416336:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789776696.416340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449616896:0@lo:8:kworker.0 00000100:00100000:3.0:1789776696.416353:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776696.416357:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776696.416359:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789776696.416361:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449617408:0@lo:8:kworker.0 00010000:00010000:3.0:1789776696.418119:0:19524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:1.0:1789776696.418449:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876716449616512:12345-0@lo:38:llog_process_th.0 Request processed in 2720us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.418459:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776696.418517:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449616640:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418572:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449617280:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776696.418611:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449616768:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449617024:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418722:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449617664:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418782:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776696.418788:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449617152:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418820:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449617792:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.418856:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617536 00000100:00100000:1.0:1789776696.418861:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617536 00000100:00100000:1.0:1789776696.418885:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617024 00000100:00100000:1.0:1789776696.418887:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617024 00000100:00100000:1.0:1789776696.418895:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617664 00000100:00100000:1.0:1789776696.418897:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617664 00000100:00100000:1.0:1789776696.418912:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617792 00000100:00100000:1.0:1789776696.418914:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617792 00000100:00100000:1.0:1789776696.418926:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776696.418933:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449617536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.418977:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449617536:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.418982:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776696.418994:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776696.418999:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449617024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419035:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876716449617024:12345-0@lo:400:kworker.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419041:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776696.419052:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776696.419058:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449617664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419080:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449617664:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419085:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776696.419093:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776696.419098:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449617792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419120:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449617792:12345-0@lo:400:kworker.0 Request processed in 22us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419125:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776696.419141:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617280 00000100:00100000:1.0:1789776696.419144:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617280 00000100:00100000:1.0:1789776696.419163:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616768 00000100:00100000:1.0:1789776696.419166:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616768 00000100:00100000:1.0:1789776696.419176:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776696.419182:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449617280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419211:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449617280:12345-0@lo:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419216:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776696.419226:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776696.419231:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449616768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419253:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449616768:12345-0@lo:400:kworker.0 Request processed in 22us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419268:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776696.419285:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449616640 00000100:00100000:1.0:1789776696.419288:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449616640 00000100:00100000:1.0:1789776696.419308:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617152 00000100:00100000:1.0:1789776696.419311:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617152 00000100:00100000:1.0:1789776696.419321:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789776696.419326:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449616640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419359:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449616640:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419364:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789776696.419374:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789776696.419379:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449617152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419405:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449617152:12345-0@lo:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776696.419410:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789776696.419436:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776696.419441:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789776696.419443:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776696.419472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449616768:0@lo:400:kworker.0 00010000:00080000:1.0:1789776696.419486:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824380 x1876716449617536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776696.419522:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419532:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449616640:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419541:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449617280:0@lo:400:kworker.0 00000100:00100000:1.0:1789776696.419569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449617152:0@lo:400:kworker.0 00010000:00080000:1.0:1789776696.419586:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824000 x1876716449617792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776696.419595:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449617792:0@lo:400:kworker.0 00010000:00080000:1.0:1789776696.419603:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff348380 x1876716449617024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776696.419610:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876716449617024:0@lo:400:kworker.0 00010000:00080000:1.0:1789776696.419619:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824e00 x1876716449617664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776696.419627:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449617664:0@lo:400:kworker.0 00010000:00080000:0.0:1789776696.420594:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3e93480 x1876716449616512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776696.420618:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776696.420628:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789776696.420638:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789776696.420649:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789776696.420653:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3d5e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776696.420660:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876716449616512:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1789776696.420858:0:19524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789776696.420913:0:19524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789776696.420922:0:19524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf13b8042cb885ea3 00000100:00080000:0.0:1789776696.420929:0:19524:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776696.420933:0:19524:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a5cf514c000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776696.420958:0:19524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cd8826680 x1876716449617920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776696.420986:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449617920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776696.421050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776696.421098:0:19524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789776696.421454:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449617920 00000100:00100000:2.0:1789776696.421461:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449617920 00000100:00100000:2.0:1789776696.421522:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776696.421530:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876716449617920:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789776696.421551:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1789776696.421581:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf13b8042cb885eaa 00000004:00100000:2.0:1789776696.421596:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789776696.421640:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8a5bc33a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776696.421690:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876716449617920:12345-0@lo:38:llog_process_th.0 Request processed in 160us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.421697:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789776696.421847:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8826680 x1876716449617920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776696.421856:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776696.421861:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789776696.421867:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789776696.421870:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789776696.421872:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cf514c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776696.421878:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876716449617920:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789776696.429354:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789776696.429483:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789776696.429540:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776696.429557:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e80 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776696.429570:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0400/0xf13b8042cb885e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885e80 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776696.429708:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776696.429710:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776696.429712:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776696.429713:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776696.429715:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776696.429716:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776696.429717:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776696.429719:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776696.429721:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776696.429734:0:19511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789776696.429743:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776696.429744:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776696.429745:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776696.429746:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776696.429746:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776696.429748:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776696.429748:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776696.429749:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776696.429750:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776696.429779:0:19511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789776696.429804:0:19511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449618048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776696.429882:0:19511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776696.430217:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618048 00000100:00100000:3.0:1789776696.430226:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618048 00000100:00100000:3.0:1789776696.430273:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789776696.430282:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449618048:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789776696.430311:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789776696.430325:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789776696.430462:0:19511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc5d13240 going to sleep for 11 seconds 20000000:01000000:3.0:1789776696.441749:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789776696.441764:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789776696.442025:0:17206:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789776696.442030:0:17206:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789776696.442053:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.442073:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.442082:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.442089:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776696.442869:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:19511:x1876716449618048:12345-0@lo:253:mount.lustre.0 Request processed in 12581us (12981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776696.442882:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:2.0:1789776696.443235:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.443252:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 24 pid: 17185 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776696.443266:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449618176:0@lo:104: 00000100:00100000:2.0:1789776696.443320:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776696.443364:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.443372:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 24 pid: 17182 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776696.443380:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449618304:0@lo:104: 00000100:00100000:2.0:1789776696.443416:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776696.443436:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc7e05e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776696.443458:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618176 00000100:00100000:2.0:1789776696.443465:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618176 00000100:00100000:2.0:1789776696.443516:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618304 00000100:00100000:2.0:1789776696.443520:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618304 00000100:00100000:2.0:1789776696.443535:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776696.443543:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449618176:12345-0@lo:104: 00010000:00010000:2.0:1789776696.443556:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776696.444050:0:19511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:086c90d1-9383-41b8-afea-b47b6abf291d:19511:1876716449618048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789776696.444063:0:19511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789776696.444067:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776696.444068:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776696.444070:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776696.444071:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776696.444072:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776696.444074:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776696.444075:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776696.444084:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776696.444086:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789776696.444102:0:19511:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789776696.444184:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776696.444192:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+4:17206:x1876716449618176:12345-0@lo:104: Request processed in 649us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.444199:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776696.444216:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776696.444223:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449618304:12345-0@lo:104: 00010000:00010000:2.0:1789776696.444233:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776696.444273:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776696.444284:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:086c90d1-9383-41b8-afea-b47b6abf291d+3:17206:x1876716449618304:12345-0@lo:104: Request processed in 62us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776696.444289:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776696.444316:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449618176:0@lo:104: 00000100:00100000:2.0:1789776696.444323:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17206:1876716449618304:0@lo:104: 00010000:00010000:2.0:1789776696.444339:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444440:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776696.444448:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444456:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776696.444460:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444469:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776696.444477:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776696.444483:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776696.444528:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444544:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776696.444564:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444571:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257c00/0xf13b8042cb885d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d6f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444582:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776696.444585:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444591:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a2000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776696.444594:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.444601:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776696.445719:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776696.445734:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776696.445764:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.445770:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776696.445781:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.445787:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a2000/0xf13b8042cb885d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d61 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.445813:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776696.445815:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776696.445817:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776696.445845:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776696.445861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449618432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776696.445999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776696.446051:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776696.446057:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449618560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776696.446080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776696.446238:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618432 00000100:00100000:0.0:1789776696.446245:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618432 00010000:00010000:0.0:1789776696.446271:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 24 pid: 17185 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776696.446306:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618560 00000100:00100000:0.0:1789776696.446309:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618560 00010000:00010000:0.0:1789776696.446320:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 25 pid: 17182 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776696.446332:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776696.446339:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:086c90d1-9383-41b8-afea-b47b6abf291d+25:3645:x1876716449618432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776696.446350:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776696.446354:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 25 pid: 17185 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.446366:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 25 pid: 17185 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.446379:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1e00/0xf13b8042cb885d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885d68 expref: 25 pid: 17185 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.446391:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776696.446449:0:17175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789776696.446457:0:17175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789776696.446990:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:086c90d1-9383-41b8-afea-b47b6abf291d+24:3645:x1876716449618432:12345-0@lo:103:ldlm_bl.0 Request processed in 650us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.446998:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776696.447017:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776696.447025:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:086c90d1-9383-41b8-afea-b47b6abf291d+23:3645:x1876716449618560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776696.447034:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776696.447038:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 23 pid: 17182 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447048:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 23 pid: 17182 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447068:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1200/0xf13b8042cb885d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885d5a expref: 23 pid: 17182 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447078:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447086:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776696.447100:0:17176:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007324537s 00010000:00010000:0.0:1789776696.447105:0:17176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776696.447207:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449618432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776696.447711:0:17176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447718:0:17176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447735:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447741:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776696.447746:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447755:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447775:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776696.447794:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776696.447842:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:086c90d1-9383-41b8-afea-b47b6abf291d+22:3645:x1876716449618560:12345-0@lo:103:ldlm_bl.0 Request processed in 817us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776696.447849:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789776696.448388:0:17206:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.448399:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776696.448406:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc4b0a800/0xf13b8042cb885eb1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776696.448448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449618560:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789776696.458391:0:19511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789776696.462299:0:19511:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789776696.462309:0:19511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789776696.462349:0:19511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789776696.462389:0:19511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789776696.462406:0:19511:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789776696.462435:0:19511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789776696.463949:0:19511:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789776696.464268:0:19511:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789776696.868429:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789776697.337699:0:19579:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776697.338050:0:19579:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789776697.378805:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776698.416754:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789776698.467576:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789776698.467585:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc378a000 from 10 10000000:01000000:2.0:1789776698.467590:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789776698.467637:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.467650:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.467661:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776698.467699:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776698.467795:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776698.467844:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc651a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789776698.467897:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618688 00000100:00100000:3.0:1789776698.467905:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618688 00000100:00100000:2.0:1789776698.468006:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789776698.468017:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449618688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776698.468031:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776698.468055:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc4b0a400/0xf13b8042cb885ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885eb8 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.468078:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc4b0a400/0xf13b8042cb885ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885eb8 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.468090:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc4b0a400/0xf13b8042cb885ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885eb8 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.468100:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0a400, rc 0) 00000100:00100000:2.0:1789776698.468150:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449618688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776698.468157:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789776698.468228:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776698.468245:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ebf expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776698.468255:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885ebf expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776698.468307:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789776698.468360:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776698.468383:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce02d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776698.468408:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618816 00000100:00100000:2.0:1789776698.468413:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618816 00000100:00100000:2.0:1789776698.468447:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776698.468454:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449618816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789776698.468467:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789776698.468484:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789776698.468488:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789776698.468581:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449618816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776698.468588:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789776698.468654:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789776698.468727:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789776698.468734:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ebf expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776698.468743:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b200/0xf13b8042cb885eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ebf expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776698.468752:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789776698.468755:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a5bc3db5000 from 10 10000000:01000000:3.0:1789776698.468763:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789776698.468781:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776698.468790:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776698.468807:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776698.468821:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776698.468847:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776698.468883:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5ce02d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776698.468900:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449618944 00000100:00100000:2.0:1789776698.468906:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449618944 00000100:00100000:2.0:1789776698.468939:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776698.468946:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449618944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776698.468963:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776698.468974:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc4b0be00/0xf13b8042cb885ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb885ec6 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.468990:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc4b0be00/0xf13b8042cb885ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb885ec6 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.468998:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc4b0be00/0xf13b8042cb885ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885ec6 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776698.469005:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0be00, rc 0) 00000100:00100000:2.0:1789776698.469050:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449618944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776698.469056:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789776698.469646:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3d1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449618944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776698.469664:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ecd expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776698.469672:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb885ecd expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776698.469895:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449619072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789776698.469934:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776698.470043:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619072 00000100:00100000:3.0:1789776698.470048:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619072 00000100:00100000:3.0:1789776698.470085:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789776698.470092:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449619072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789776698.470121:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789776698.470136:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789776698.470139:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789776698.470209:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449619072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776698.470217:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789776698.470438:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf50846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776698.470453:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449619072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789776698.470544:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776698.470551:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ecd expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776698.470561:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cfc257a00/0xf13b8042cb885ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb885ecd expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776699.427288:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776699.429416:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449619200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776699.429487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776699.429698:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619200 00000100:00100000:0.0:1789776699.429708:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619200 00000100:00100000:0.0:1789776699.429777:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776699.429788:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449619200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789776699.429820:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789776699.429875:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449619200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776699.429882:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789776699.430173:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776699.430213:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449619200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776699.940094:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449619328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776699.940176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776699.940299:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619328 00000100:00100000:1.0:1789776699.940308:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619328 00000100:00100000:1.0:1789776699.940374:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789776699.940384:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449619328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776699.940421:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789776699.940482:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449619328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776699.940489:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776699.940597:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449619328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776699.940806:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776699.940817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449619456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776699.940847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776699.940927:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619456 00000100:00100000:2.0:1789776699.940932:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619456 00000100:00100000:2.0:1789776699.940967:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776699.940975:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449619456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789776699.940995:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789776699.941036:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449619456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776699.941042:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776699.941089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449619456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776700.451076:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449619584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776700.451155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776700.451214:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619584 00000100:00100000:1.0:1789776700.451221:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619584 00000100:00100000:1.0:1789776700.451274:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776700.451284:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449619584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776700.451304:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776700.451356:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449619584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776700.451363:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789776700.451383:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776700.451432:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449619584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776700.453756:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789776701.474716:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776701.474723:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776701.474726:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776701.474739:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a5cfaf0f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776701.474762:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cd8827480 x1876716449620096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776701.474798:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776701.474802:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776701.474803:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776701.474809:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a5cd8514000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1789776701.474820:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a5cd8826a00 x1876716449620608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776701.474941:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449619712:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475052:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449620352:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475078:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475099:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449620992:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475148:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789776701.475155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449619840:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449620480:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475239:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449621120:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449619968:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475329:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449620736:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475361:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475396:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776701.475401:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449620224:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475432:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449620864:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475487:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449620096:0@lo:8:kworker.0 00000100:00100000:0.0:1789776701.475532:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475547:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449620608:0@lo:8:kworker.0 00000100:00100000:0.0:1789776701.475567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.475598:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619712 00000100:00100000:0.0:1789776701.475606:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619712 00000100:00100000:0.0:1789776701.475664:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789776701.475674:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449619712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475723:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449619712:12345-0@lo:400:kworker.0 Request processed in 50us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.475730:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789776701.475760:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620352 00000100:00100000:0.0:1789776701.475765:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620352 00000100:00100000:0.0:1789776701.475787:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619840 00000100:00100000:0.0:1789776701.475790:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619840 00000100:00100000:0.0:1789776701.475804:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789776701.475810:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449620352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475844:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449620352:12345-0@lo:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.475850:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789776701.475862:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789776701.475869:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449619840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.475897:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449619840:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.475902:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789776701.475927:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620992 00000100:00100000:0.0:1789776701.475930:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620992 00000100:00100000:0.0:1789776701.475961:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621120 00000100:00100000:0.0:1789776701.475964:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621120 00000100:00100000:0.0:1789776701.475977:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620736 00000100:00100000:0.0:1789776701.475980:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620736 00000100:00100000:0.0:1789776701.475990:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621248 00000100:00100000:0.0:1789776701.475992:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621248 00000100:00100000:0.0:1789776701.476002:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620224 00000100:00100000:0.0:1789776701.476004:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620224 00000100:00100000:0.0:1789776701.476014:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620864 00000100:00100000:0.0:1789776701.476016:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620864 00000100:00100000:0.0:1789776701.476029:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776701.476035:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449620992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476068:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449620992:12345-0@lo:400:kworker.0 Request processed in 34us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476074:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776701.476085:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789776701.476091:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449621120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476135:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449621120:12345-0@lo:400:kworker.0 Request processed in 44us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476143:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789776701.476155:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776701.476161:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476190:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876716449620736:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476196:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776701.476207:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789776701.476213:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449621248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476248:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876716449621248:12345-0@lo:400:kworker.0 Request processed in 36us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476255:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789776701.476266:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776701.476272:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449620224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476297:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876716449620224:12345-0@lo:400:kworker.0 Request processed in 25us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476303:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776701.476314:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776701.476319:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449620864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476343:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449620864:12345-0@lo:400:kworker.0 Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476348:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776701.476370:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620480 00000100:00100000:0.0:1789776701.476374:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620480 00000100:00100000:0.0:1789776701.476396:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449619968 00000100:00100000:0.0:1789776701.476399:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449619968 00000100:00100000:0.0:1789776701.476408:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620096 00000100:00100000:0.0:1789776701.476410:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620096 00000100:00100000:0.0:1789776701.476416:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449620608 00000100:00100000:0.0:1789776701.476419:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449620608 00000100:00100000:0.0:1789776701.476427:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776701.476433:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449620480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476464:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449620480:12345-0@lo:400:kworker.0 Request processed in 31us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476470:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776701.476481:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776701.476518:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449619968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.476550:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449619968:12345-0@lo:400:kworker.0 Request processed in 57us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476556:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776701.476569:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776701.476573:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1876716449620096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789776701.476598:0:19184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1789776701.476641:0:19184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf13b8042cb885ed4 00002000:00100000:0.0:1789776701.476657:0:19184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a5bc3d59000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789776701.476661:0:19184:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789776701.476664:0:19184:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789776701.476847:0:19184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789776701.476873:0:19184:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3d5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776701.476916:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1876716449620096:12345-0@lo:8:kworker.0 Request processed in 341us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.476922:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776701.476934:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776701.476938:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1876716449620608:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789776701.476953:0:19184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1789776701.476968:0:19184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf13b8042cb885edb 00002000:00100000:0.0:1789776701.476974:0:19184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a5bc3d5f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789776701.476978:0:19184:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789776701.476980:0:19184:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789776701.477001:0:19184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789776701.477014:0:19184:0:(import.c:65:import_set_state_nolock()) ffff8a5bc3d5b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776701.477051:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1876716449620608:12345-0@lo:8:kworker.0 Request processed in 110us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.477056:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789776701.477094:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776701.477098:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776701.477100:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789776701.477129:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8827480 x1876716449620096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776701.477145:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789776701.477152:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789776701.477157:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789776701.477159:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cfaf0f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789776701.477173:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789776701.477178:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876716449620096:0@lo:8:kworker.0 00010000:00080000:0.0:1789776701.477191:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8826a00 x1876716449620608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776701.477200:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789776701.477205:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789776701.477208:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789776701.477210:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a5cd8514000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789776701.477231:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789776701.477235:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876716449620608:0@lo:8:kworker.0 00000004:00080000:0.0:1789776701.477298:0:17217:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789776701.477366:0:17217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17217:1876716449621504:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789776701.477516:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.477537:0:17217:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b540 going to sleep for 11 seconds 00000004:00080000:0.0:1789776701.477560:0:17216:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789776701.477623:0:17216:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522722129393ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789776701.477642:0:17216:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789776701.477664:0:17933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789776701.477705:0:17933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 522722211135ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789776701.477709:0:17933:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789776701.477926:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449621376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776701.477957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776701.477991:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621376 00000100:00100000:0.0:1789776701.477997:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621376 00000100:00100000:0.0:1789776701.478037:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776701.478045:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449621376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776701.478065:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776701.478103:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876716449621376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.478109:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789776701.478128:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789776701.478148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc397480 x1876716449621376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478164:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449621376:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789776701.478192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824700 x1876716449620224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876716449620224:0@lo:400:kworker.0 00010000:00080000:0.0:1789776701.478213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8826680 x1876716449620864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478221:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449620864:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449619968:0@lo:400:kworker.0 00010000:00080000:0.0:1789776701.478255:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8825500 x1876716449620736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876716449620736:0@lo:400:kworker.0 00010000:00080000:0.0:1789776701.478273:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8825880 x1876716449621248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478281:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876716449621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449619840:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478367:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449620480:0@lo:400:kworker.0 00010000:00080000:0.0:1789776701.478379:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824000 x1876716449621120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478388:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449621120:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478398:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449619712:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478409:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449620352:0@lo:400:kworker.0 00010000:00080000:0.0:1789776701.478420:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8824e00 x1876716449620992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776701.478429:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449620992:0@lo:400:kworker.0 00000100:00100000:0.0:1789776701.478576:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621504 00000100:00100000:0.0:1789776701.478581:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621504 00000100:00100000:0.0:1789776701.478606:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776701.478614:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17217:x1876716449621504:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1789776701.479222:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789776701.479283:0:17934:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789776701.479304:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449621760:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789776701.479347:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776701.479369:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc9005900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776701.479381:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776701.479390:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449621632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776701.479414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776701.479441:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621760 00000100:00100000:2.0:1789776701.479446:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621760 00000100:00100000:2.0:1789776701.479483:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776701.479511:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1876716449621760:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789776701.479548:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776701.479561:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621632 00000100:00100000:2.0:1789776701.479564:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621632 00000100:00100000:2.0:1789776701.479588:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776701.479595:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876716449621632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789776701.479606:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789776701.479661:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876716449621632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776701.479667:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789776701.479704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35e680 x1876716449621632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776701.479719:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449621632:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789776701.482478:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1789776701.482803:0:19184:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789776701.482821:0:19184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789776701.482827:0:19184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:0.0:1789776701.487040:0:18697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789776701.487050:0:18697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789776701.487156:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1876716449621760:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7660us (7803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.487167:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789776701.487265:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff35d180 x1876716449621760/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776701.487281:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449621760:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789776701.487293:0:17934:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789776701.487329:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449621888:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789776701.487361:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776701.487391:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8736780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776701.487441:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449621888 00000100:00100000:0.0:1789776701.487447:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449621888 00000100:00100000:0.0:1789776701.487487:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789776701.487518:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17934:x1876716449621888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789776701.487541:0:18695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789776701.487568:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17934:x1876716449621888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.487574:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789776701.487652:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f4700 x1876716449621888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776701.487662:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449621888:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789776701.487670:0:17934:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789776701.487690:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449622016:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789776701.487721:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776701.487741:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8736780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776701.487783:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622016 00000100:00100000:0.0:1789776701.487786:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622016 00000100:00100000:0.0:1789776701.487928:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776701.487935:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1876716449622016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789776701.487958:0:18697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1789776701.496051:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.496064:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496082:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.496087:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.496094:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496113:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496124:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496133:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496152:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789776701.496461:0:17170:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789776701.496686:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.496692:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496703:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.496707:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.496719:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496729:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496738:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496746:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.496762:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789776701.497156:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.497163:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497173:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.497176:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.497180:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497190:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497198:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497218:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497231:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789776701.497244:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776701.497250:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497257:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0ba00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.497261:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497269:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497287:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497294:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885ee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497311:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776701.497314:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497331:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.497334:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497340:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497353:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497359:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885ee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497372:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.497375:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497380:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.497383:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497390:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497398:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497411:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885ef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497423:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.497425:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.497426:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.497768:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.497774:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497782:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.497785:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.497789:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497810:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497818:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.497824:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.498144:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.498151:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.498195:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.498203:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.498215:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498221:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0ae00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.498225:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498233:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498245:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498253:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885ef7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498267:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.498269:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.498270:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.498606:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.498613:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498622:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.498638:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.498642:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498663:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498672:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498678:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.498697:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776701.499273:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.499281:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.499289:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0aa00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.499293:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.499301:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.499319:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.499326:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003989d611/0xf13b8042cb885efe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.499343:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.499345:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.499347:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.499427:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.499433:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.499442:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.499446:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.499451:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.499461:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.499469:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.499489:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.499538:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776701.500161:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.500168:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.500190:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.500194:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.500203:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.500215:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.500222:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ecbfec/0xf13b8042cb885f05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.500239:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.500241:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.500243:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776701.500857:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789776701.500867:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.500877:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:0.0:1789776701.500881:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776701.500886:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.500910:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.500920:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.500928:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.500950:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.501139:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.501146:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.501154:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdfa00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.501157:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.501165:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.501177:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.501183:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020d9c7ac/0xf13b8042cb885f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.501197:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.501198:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.501200:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.502811:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.503062:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.503081:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.503085:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.503092:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.503105:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.503116:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.503124:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.503146:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776701.503357:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.503364:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.503373:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.503377:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.503386:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.503407:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.503414:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.503434:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.503436:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.503437:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.504138:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.504146:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.504156:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.504159:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.504164:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.504174:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.504189:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.504196:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.504212:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776701.505132:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.505140:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.505150:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.505155:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.505164:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.505180:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.505187:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.505221:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.505223:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.505225:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.506414:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.506426:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.506443:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.506447:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.506454:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.506466:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.506476:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.506485:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.506532:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776701.506732:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776701.506739:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.506746:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:0.0:1789776701.506750:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.506757:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.506772:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.506779:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.506809:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776701.506811:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776701.506812:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789776701.512780:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00002000:00010000:0.0:1789776701.513020:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789776701.513030:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.513047:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:0.0:1789776701.513051:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776701.513058:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.513071:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.513082:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.513090:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776701.513106:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:2.0:1789776701.513322:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789776701.513328:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789776701.513549:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.513557:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.513566:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cdf200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.513571:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.513580:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.513597:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.513605:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000983356d8/0xf13b8042cb885f28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.513621:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.513623:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.513635:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776701.513932:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17934:x1876716449622016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 25993us (26205us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789776701.513941:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776701.514081:0:17934:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789776701.514089:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876716449622016:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789776701.514113:0:17934:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789776701.514166:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1876716449622144:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789776701.514204:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776701.514233:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc8736780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776701.514334:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622144 00000100:00100000:0.0:1789776701.514345:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622144 00000100:00100000:0.0:1789776701.514391:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776701.514400:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1876716449622144:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789776701.514459:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1876716449622144:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776701.514466:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789776701.514563:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cff3f4700 x1876716449622144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789776717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776701.514574:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff3f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1876716449622144:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789776701.519145:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.519161:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.519179:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.519184:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.519190:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.519205:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.519215:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.519223:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.519249:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.519271:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.519290:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.519309:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.519314:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.519323:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.519343:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.519350:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36784cc/0xf13b8042cb885f2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.519371:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.519372:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.519374:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.521017:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.521029:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521051:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.521055:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.521061:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521074:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521084:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521092:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521113:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776701.521545:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.521553:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521561:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.521564:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.521567:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521575:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521593:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521599:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.521618:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789776701.522407:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776701.522414:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.522416:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.522419:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522427:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0ae00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.522427:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.522432:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.522432:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.522443:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522453:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.522460:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522462:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.522469:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0cc7f51/0xf13b8042cb885f3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522470:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db35f6b6/0xf13b8042cb885f36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522489:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.522489:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.522510:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.522512:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.522513:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.522514:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.522640:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.522647:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.522655:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.522659:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.522664:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.522674:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.522683:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.522691:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.522722:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.522746:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.522752:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522759:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0ba00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.522762:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522769:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522780:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522796:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d485ac14/0xf13b8042cb885f44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.522810:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.522812:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.522814:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.523091:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.523097:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523105:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.523109:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.523113:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523122:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523129:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523137:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523156:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776701.523352:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.523357:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.523365:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0ac00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.523369:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.523376:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.523388:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.523395:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080f0424a/0xf13b8042cb885f4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.523411:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.523412:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.523414:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.523485:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.523519:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523529:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.523538:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.523542:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523550:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523558:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523565:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.523578:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.523731:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.523736:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.523744:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.523748:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.523756:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.523768:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.523776:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fcf600e/0xf13b8042cb885f52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.523789:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.523791:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.523793:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.525007:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.525020:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525034:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.525038:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.525044:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525055:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525065:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525082:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525106:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.525140:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.525147:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.525154:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0bc00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.525157:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.525165:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.525180:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.525186:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000906e7779/0xf13b8042cb885f59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.525204:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.525206:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.525207:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776701.525683:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.525689:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525698:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.525702:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.525706:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525716:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525724:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525731:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.525783:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776701.528291:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.528307:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.528340:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.528345:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.528353:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.528367:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.528378:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.528386:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528643:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776701.528652:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528661:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.528666:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528681:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528699:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528706:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c46bf60/0xf13b8042cb885f60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528725:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.528729:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528735:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.528739:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528746:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528755:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.528763:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.528765:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.528773:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.531531:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776701.531538:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.531546:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005418c372/0xf13b8042cb885f67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776701.532303:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.532312:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.532327:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789776701.532331:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.532337:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.532365:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.532375:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.532383:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.532408:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.532435:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.532443:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.532451:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b400 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.532455:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.532476:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.532516:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.532524:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a353df7/0xf13b8042cb885f6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.532543:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.532545:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.532547:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.534116:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.534128:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534143:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.534148:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.534154:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534165:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534175:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534195:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534221:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.534246:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.534252:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.534260:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256a00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.534264:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.534272:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.534293:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.534300:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d132bb/0xf13b8042cb885f75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.534324:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.534326:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.534328:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.534750:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.534756:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534766:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.534770:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.534774:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534784:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534792:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534800:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.534824:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.535059:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.535065:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535073:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257800 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.535077:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535085:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776701.535093:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789776701.535097:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535098:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535104:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd1f95f5/0xf13b8042cb885f7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535112:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.535115:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776701.535119:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.535120:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535121:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.535122:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.535129:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535138:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535145:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535166:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.535183:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.535187:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535205:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.535209:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535216:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535227:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535234:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056a2dc98/0xf13b8042cb885f83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535248:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.535250:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.535252:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.535423:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.535429:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535437:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.535441:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.535445:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535454:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535473:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535517:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535536:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.535560:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.535565:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535572:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.535575:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535583:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535599:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535607:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b4ac897/0xf13b8042cb885f8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.535622:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.535623:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.535639:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.535968:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.535974:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.535983:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.535987:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.535991:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536000:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536008:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536015:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536053:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776701.536062:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776701.536065:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536073:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256200 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776701.536076:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536085:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536096:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536103:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065cbda55/0xf13b8042cb885f91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536115:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.536116:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776701.536118:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.536722:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.536729:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536739:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.536748:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.536753:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536764:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536772:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536780:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.536799:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776701.536973:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776701.536979:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.536987:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776701.536990:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.536999:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.537012:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.537018:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040519f09/0xf13b8042cb885f98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776701.537045:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.537047:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776701.537048:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776701.537179:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789776701.537185:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.537193:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789776701.537196:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776701.537200:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.537210:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.537218:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.537231:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776701.537251:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789776701.537285:0:19184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:1.0:1789776701.537327:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776701.537333:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.537340:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776701.537343:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.537350:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.537360:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.537367:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a6d67e/0xf13b8042cb885f9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776701.537381:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.537383:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776701.537384:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776701.537393:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17217:x1876716449621504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 58775us (59873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776701.537402:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776701.537448:0:17217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17217:1876716449621504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789776701.537464:0:17217:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789776701.537610:0:17217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17217:1876716449622272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789776701.537659:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776701.537717:0:17217:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc3150600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776701.539342:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622272 00000100:00100000:1.0:1789776701.539354:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622272 00000100:00100000:1.0:1789776701.539445:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776701.539456:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17217:x1876716449622272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789776701.539513:0:18698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1789776701.545698:0:17217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff35e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17217:1876716449622272:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789776701.545717:0:17217:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1789776701.545933:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17217:x1876716449622272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6204us (7998us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789776701.545945:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:02000400:3.0:1789776702.469902:0:19868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789776702.499932:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776702.948552:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789776703.393347:0:19920:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776703.393767:0:19920:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789776703.529353:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789776704.270432:0:19971:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789776704.271055:0:19971:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789776704.546837:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449622400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776704.546923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776704.547036:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622400 00000100:00100000:3.0:1789776704.547046:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622400 00010000:00010000:1.0:1789776704.547062:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776704.547175:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776704.548618:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776704.548642:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449622400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789776704.548678:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789776704.548763:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449622400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.548771:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776704.548906:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449622400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789776704.661994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.662692:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771712 00000100:00100000:2.0:1789776704.662703:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771712 00000100:00100000:2.0:1789776704.662757:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1789776704.662766:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2410:x1876716432771712:12345-192.168.204.27@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789776704.662794:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9b16530f-c033-42a8-8d5b-836bd948ad72@192.168.204.27@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1789776704.662825:0:17185:0:(genops.c:1385:class_connect()) connect: client 9b16530f-c033-42a8-8d5b-836bd948ad72, cookie 0xf13b8042cb885fa6 00000100:00080000:2.0:1789776704.662982:0:17185:0:(import.c:65:import_set_state_nolock()) ffff8a5bc33a2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776704.663069:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+5:2410:x1876716432771712:12345-192.168.204.27@tcp:250:mount.lustre.0 Request processed in 302us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.663092:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:3.0:1789776704.679028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.679636:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771840 00000100:00100000:0.0:1789776704.679647:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771840 00000100:00100000:0.0:1789776704.679714:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:0.0:1789776704.679726:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+5:14909:x1876716432771840:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776704.679753:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776704.679772:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885fad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b40 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.679802:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b40 expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.679813:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdee00/0xf13b8042cb885fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b40 expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.679823:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdee00, rc 0) 00000100:00100000:0.0:1789776704.679895:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+6:14909:x1876716432771840:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 171us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.679903:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1789776704.701474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.701873:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432771968 00000100:00100000:2.0:1789776704.701888:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432771968 00000100:00100000:2.0:1789776704.701975:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1789776704.701986:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+6:14909:x1876716432771968:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776704.702120:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+6:14909:x1876716432771968:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 135us (655us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776704.702128:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1789776704.710690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.710813:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772096 00000100:00100000:3.0:1789776704.710823:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772096 00000100:00100000:3.0:1789776704.710874:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:3.0:1789776704.710885:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+6:14909:x1876716432772096:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789776704.710913:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776704.710932:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217ec00/0xf13b8042cb885fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b47 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.710961:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217ec00/0xf13b8042cb885fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b47 expref: 7 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.710972:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217ec00/0xf13b8042cb885fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b47 expref: 7 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.710982:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ec00, rc 0) 00000100:00100000:3.0:1789776704.711036:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+7:14909:x1876716432772096:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 153us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.711043:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:3.0:1789776704.728581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.728621:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772224 00000100:00100000:0.0:1789776704.728632:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772224 00000100:00100000:0.0:1789776704.728687:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:0.0:1789776704.728698:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+7:14909:x1876716432772224:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789776704.728904:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14909:x1876716432772224:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 207us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.728913:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1789776704.732169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.732269:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772352 00000100:00100000:2.0:1789776704.732280:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772352 00000100:00100000:2.0:1789776704.732376:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1789776704.732386:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14909:x1876716432772352:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789776704.732586:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14909:x1876716432772352:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 200us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.732594:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:0.0:1789776704.745109:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.745408:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772480 00000100:00100000:3.0:1789776704.745418:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772480 00000100:00100000:3.0:1789776704.745473:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1789776704.745482:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772480:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776704.745688:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772480:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 206us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.745696:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:0.0:1789776704.780669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.781015:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772608 00000100:00100000:3.0:1789776704.781029:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772608 00000100:00100000:3.0:1789776704.781147:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:3.0:1789776704.781161:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772608:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776704.781413:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772608:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 254us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.781423:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:1.0:1789776704.787840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.788005:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772736 00000100:00100000:2.0:1789776704.788021:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772736 00000100:00100000:2.0:1789776704.788110:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1789776704.788123:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772736:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776704.788378:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14927:x1876716432772736:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 257us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.788387:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1789776704.795885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.796066:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772864 00000100:00100000:3.0:1789776704.796083:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772864 00000100:00100000:3.0:1789776704.796155:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1789776704.796167:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+8:14909:x1876716432772864:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789776704.796200:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776704.796224:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217f800/0xf13b8042cb885fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b78 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.796263:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217f800/0xf13b8042cb885fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b78 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.796276:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217f800/0xf13b8042cb885fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b78 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776704.796288:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217f800, rc 0) 00000100:00100000:3.0:1789776704.796374:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+9:14909:x1876716432772864:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 209us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.796383:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1789776704.801634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.801875:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432772992 00000100:00100000:0.0:1789776704.801891:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432772992 00000100:00100000:0.0:1789776704.801969:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:0.0:1789776704.801980:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cede9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+9:14909:x1876716432772992:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789776704.802018:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789776704.802054:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789776704.802059:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789776704.802063:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789776704.802066:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789776704.802069:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789776704.807632:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cede9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+9:14909:x1876716432772992:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 5635us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.807652:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:2.0:1789776704.816988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.817432:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773120 00000100:00100000:3.0:1789776704.817454:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773120 00000100:00100000:0.0:1789776704.817833:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:0.0:1789776704.817847:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+9:14909:x1876716432773120:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776704.817866:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776704.817888:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5b7f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.817918:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.817943:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776704.817953:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cde200, rc 0) 00000100:00100000:0.0:1789776704.820541:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14909:x1876716432773120:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 2686us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.820555:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:0.0:1789776704.823999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.824182:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773248 00000100:00100000:3.0:1789776704.824191:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773248 00000100:00100000:3.0:1789776704.824297:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1789776704.824307:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14909:x1876716432773248:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789776704.824473:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14909:x1876716432773248:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 166us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.824481:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:1.0:1789776704.827373:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.827484:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773376 00000100:00100000:0.0:1789776704.827681:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773376 00000100:00100000:0.0:1789776704.828117:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1789776704.828130:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14909:x1876716432773376:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789776704.828333:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfcaed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14909:x1876716432773376:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 205us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.828341:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1789776704.834874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.834965:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773504 00000100:00100000:3.0:1789776704.834976:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773504 00000100:00100000:3.0:1789776704.835049:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:3.0:1789776704.835062:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14932:x1876716432773504:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776704.835234:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14932:x1876716432773504:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 174us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776704.835242:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:1.0:1789776704.841406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.841536:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773632 00000100:00100000:0.0:1789776704.841547:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773632 00000100:00100000:0.0:1789776704.841611:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:0.0:1789776704.841621:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14932:x1876716432773632:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776704.841971:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:14932:x1876716432773632:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 349us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.841980:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:1.0:1789776704.851701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776704.851784:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.852056:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773760 00000100:00100000:2.0:1789776704.852066:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773760 00000100:00100000:2.0:1789776704.852114:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774016 00000100:00100000:2.0:1789776704.852117:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774016 00000100:00100000:2.0:1789776704.852145:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1789776704.852153:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1876716432773760:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789776704.852184:0:17190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 46b2d271-3290-4278-a9ba-b0b58b3db4ff@192.168.204.27@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789776704.852235:0:17190:0:(genops.c:1385:class_connect()) connect: client 46b2d271-3290-4278-a9ba-b0b58b3db4ff, cookie 0xf13b8042cb885fc9 00000004:00100000:2.0:1789776704.852261:0:17190:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789776704.852484:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8a5cef9df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776704.852595:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2410:x1876716432773760:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 441us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.852603:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1789776704.852621:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1789776704.852626:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1876716432774016:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789776704.852641:0:17190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 46b2d271-3290-4278-a9ba-b0b58b3db4ff@192.168.204.27@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789776704.852672:0:17190:0:(genops.c:1385:class_connect()) connect: client 46b2d271-3290-4278-a9ba-b0b58b3db4ff, cookie 0xf13b8042cb885fd0 00000004:00100000:2.0:1789776704.852686:0:17190:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789776704.852950:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8a5cef9de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776704.852977:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2410:x1876716432774016:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 349us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.852985:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1789776704.855457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.856386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.863284:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774144 00000100:00100000:3.0:1789776704.863419:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774144 00000100:00080000:3.0:1789776704.868936:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776704.870741:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432773888 00000100:00100000:0.0:1789776704.870771:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432773888 00000100:00100000:0.0:1789776704.870880:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776704.870893:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:0:x1876716432774144:12345-192.168.204.27@tcp:41:mount.lustre.0 00000100:00080000:3.0:1789776704.870931:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789776704.870936:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789776704.871043:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:0:x1876716432774144:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 153us (15594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.871051:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776704.871072:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1789776704.871079:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:0:x1876716432773888:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776704.871096:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789776704.871131:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:0:x1876716432773888:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 53us (14750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.871137:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1789776704.873367:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776704.873533:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774272 00000100:00100000:0.0:1789776704.873543:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774272 00000100:00100000:0.0:1789776704.873607:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1789776704.873616:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774272:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776704.873646:0:18719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789776704.873718:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774272:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.873726:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1789776704.883336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776704.883439:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774400 00000100:00100000:2.0:1789776704.883449:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774400 00000100:00100000:2.0:1789776704.883543:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1789776704.883554:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774400:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789776704.883667:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774400:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776704.883674:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1789776704.891490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.891577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776704.891610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776704.891757:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774528 00000100:00100000:1.0:1789776704.891767:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774528 00000100:00100000:1.0:1789776704.891813:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774656 00000100:00100000:1.0:1789776704.891816:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774656 00000100:00100000:1.0:1789776704.891834:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1789776704.891842:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1876716432774528:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776704.891876:0:19184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 46b2d271-3290-4278-a9ba-b0b58b3db4ff@192.168.204.27@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1789776704.891909:0:19184:0:(genops.c:1385:class_connect()) connect: client 46b2d271-3290-4278-a9ba-b0b58b3db4ff, cookie 0xf13b8042cb885fd7 00002000:00100000:1.0:1789776704.891922:0:19184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 46b2d271-3290-4278-a9ba-b0b58b3db4ff/ffff8a5cc91fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776704.891934:0:19184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776704.892104:0:19184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789776704.892135:0:19184:0:(import.c:65:import_set_state_nolock()) ffff8a5cc91f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776704.892197:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2410:x1876716432774528:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 355us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776704.892205:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1789776704.892220:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1789776704.892224:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1876716432774656:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776704.892239:0:19184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 46b2d271-3290-4278-a9ba-b0b58b3db4ff@192.168.204.27@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1789776704.892255:0:19184:0:(genops.c:1385:class_connect()) connect: client 46b2d271-3290-4278-a9ba-b0b58b3db4ff, cookie 0xf13b8042cb885fde 00002000:00100000:1.0:1789776704.892273:0:19184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 46b2d271-3290-4278-a9ba-b0b58b3db4ff/ffff8a5cc91fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776704.892285:0:19184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776704.892381:0:19184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789776704.892398:0:19184:0:(import.c:65:import_set_state_nolock()) ffff8a5cc91fd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776704.892424:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2410:x1876716432774656:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 197us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776704.892431:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776704.896151:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774784 00000100:00100000:0.0:1789776704.896166:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774784 00000100:00100000:0.0:1789776704.896234:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1789776704.896245:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774784:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789776704.896342:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774784:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 98us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.896350:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1789776704.902098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776704.902229:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432774912 00000100:00100000:1.0:1789776704.902240:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432774912 00000100:00100000:1.0:1789776704.902297:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1789776704.902309:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774912:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789776704.903619:0:17193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1202us 00000004:00200000:0.0:1789776704.928188:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789776704.928331:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14909:x1876716432774912:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 26018us (26238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776704.928347:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1789776705.058745:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449622528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776705.058821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776705.058847:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622528 00000100:00100000:3.0:1789776705.058855:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622528 00000100:00100000:3.0:1789776705.059091:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789776705.059097:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449622656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776705.059102:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449622528:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789776705.059126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1789776705.059142:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789776705.059247:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622656 00000100:00100000:0.0:1789776705.059252:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622656 00000100:00100000:0.0:1789776705.059274:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789776705.059281:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449622656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789776705.059295:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789776705.059330:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449622656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776705.059336:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789776705.059382:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449622656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776705.065124:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449622528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6011us (6291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776705.065140:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776705.065394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449622528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776705.159198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776705.159314:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775040 00000100:00100000:1.0:1789776705.159324:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775040 00000100:00100000:1.0:1789776705.159387:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1789776705.159398:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:14955:x1876716432775040:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1789776705.159418:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776705.159583:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb885fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5bb0 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159659:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159673:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159687:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776705.159760:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789776705.159764:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776705.159801:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159827:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb885fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bb0 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159846:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bb0 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776705.159854:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:1.0:1789776705.159857:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776705.159860:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c0000, rc 0) 00000100:00100000:1.0:1789776705.159925:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:14955:x1876716432775040:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 529us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776705.159931:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1789776705.570792:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776705.570818:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449622784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776705.570891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776705.571047:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776705.571516:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622784 00000100:00100000:1.0:1789776705.571525:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622784 00000100:00100000:1.0:1789776705.571640:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776705.571651:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449622784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776705.571676:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776705.571746:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449622784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776705.571753:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776705.571853:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449622784:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789776705.571926:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789776706.084090:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776706.594922:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776706.595137:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776706.595161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449622912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776706.595236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776706.595423:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449622912 00000100:00100000:1.0:1789776706.595432:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449622912 00000100:00100000:1.0:1789776706.595558:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776706.595580:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449622912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776706.595606:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789776706.595654:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449622912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776706.595661:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789776706.595848:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776706.595885:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449622912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776706.597127:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449623168:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776706.597224:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449623680:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776706.597265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449624192:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776706.597391:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789776706.597397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:086c90d1-9383-41b8-afea-b47b6abf291d:3646:1876716449623040:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776706.597444:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449623552:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776706.597483:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449624064:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.597539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598171:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623168 00000100:00100000:3.0:1789776706.598180:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623168 00000100:00100000:3.0:1789776706.598222:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623680 00000100:00100000:3.0:1789776706.598226:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623680 00000100:00100000:3.0:1789776706.598245:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776706.598252:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449623168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598313:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449623168:12345-0@lo:400:kworker.0 Request processed in 61us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.598320:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776706.598338:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776706.598344:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449623680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598371:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449623680:12345-0@lo:400:kworker.0 Request processed in 27us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.598377:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776706.598411:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449623296:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598460:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449623808:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598540:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449624320:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598597:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789776706.598603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449623424:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598637:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449623936:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598666:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449624448:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598688:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776706.598709:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623296 00000100:00100000:3.0:1789776706.598712:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623296 00000100:00100000:3.0:1789776706.598736:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623808 00000100:00100000:3.0:1789776706.598739:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623808 00000100:00100000:3.0:1789776706.598762:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623424 00000100:00100000:3.0:1789776706.598764:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623424 00000100:00100000:3.0:1789776706.598780:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776706.598786:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449623296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598822:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449623296:12345-0@lo:400:kworker.0 Request processed in 36us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.598828:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776706.598841:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776706.598847:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449623808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598883:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449623808:12345-0@lo:400:kworker.0 Request processed in 37us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.598889:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776706.598901:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776706.598907:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.598932:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876716449623424:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.598937:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789776706.598956:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776706.598960:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776706.599007:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449623424:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449623296:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599031:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449623808:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599083:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624192 00000100:00100000:3.0:1789776706.599087:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624192 00000100:00100000:3.0:1789776706.599111:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623552 00000100:00100000:3.0:1789776706.599114:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623552 00000100:00100000:3.0:1789776706.599125:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624064 00000100:00100000:3.0:1789776706.599127:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624064 00000100:00100000:3.0:1789776706.599137:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624320 00000100:00100000:3.0:1789776706.599139:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624320 00000100:00100000:3.0:1789776706.599149:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623936 00000100:00100000:3.0:1789776706.599152:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623936 00000100:00100000:3.0:1789776706.599161:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624448 00000100:00100000:3.0:1789776706.599163:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624448 00000100:00100000:3.0:1789776706.599176:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789776706.599182:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449624192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599224:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449624192:12345-0@lo:400:kworker.0 Request processed in 42us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599230:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789776706.599243:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776706.599249:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449623552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599277:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449623552:12345-0@lo:400:kworker.0 Request processed in 29us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599283:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776706.599293:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776706.599299:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449624064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599323:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876716449624064:12345-0@lo:400:kworker.0 Request processed in 25us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599328:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776706.599339:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789776706.599345:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449624320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599376:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876716449624320:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599382:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789776706.599393:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776706.599399:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449623936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599426:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876716449623936:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599431:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776706.599442:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789776706.599448:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449624448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599521:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876716449624448:12345-0@lo:400:kworker.0 Request processed in 73us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776706.599540:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789776706.599556:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776706.599558:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789776706.599576:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876716449623936:0@lo:400:kworker.0 00010000:00080000:3.0:1789776706.599589:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8825880 x1876716449624448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776706.599598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876716449624448:0@lo:400:kworker.0 00000100:00100000:3.0:1789776706.599608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876716449624320:0@lo:400:kworker.0 00000100:00100000:2.0:1789776706.599973:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449623040 00000100:00100000:2.0:1789776706.599977:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449623040 00000100:00100000:2.0:1789776706.600029:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789776706.600036:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:3646:x1876716449623040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776706.600072:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:3646:x1876716449623040:12345-0@lo:400:kworker.0 Request processed in 38us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776706.600078:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789776706.600418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449624576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776706.600465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776706.600864:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624576 00000100:00100000:2.0:1789776706.600871:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624576 00000100:00100000:2.0:1789776706.600915:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776706.600923:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449624576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776706.600955:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789776706.601010:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876716449624576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776706.601016:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776706.601052:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449624576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776706.601240:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:086c90d1-9383-41b8-afea-b47b6abf291d:3646:1876716449623040:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.601256:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449623552:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.601269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876716449624064:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.601281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449623168:0@lo:400:kworker.0 00000100:00100000:0.0:1789776706.601292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449623680:0@lo:400:kworker.0 00010000:00080000:0.0:1789776706.601306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd8826300 x1876716449624192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776706.601315:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd8826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449624192:0@lo:400:kworker.0 00000100:00100000:0.0:1789776707.384264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.384393:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775168 00000100:00100000:3.0:1789776707.384403:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775168 00000100:00100000:3.0:1789776707.384484:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1789776707.384539:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15008:x1876716432775168:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:3.0:1789776707.384582:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789776707.384685:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15008:x1876716432775168:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 191us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.384693:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:0.0:1789776707.384905:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776707.387676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.387798:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775296 00000100:00100000:0.0:1789776707.387808:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775296 00000100:00100000:0.0:1789776707.387886:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1789776707.387898:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775296:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:0.0:1789776707.387936:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789776707.390572:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775296:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 2661us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.390589:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:3.0:1789776707.390807:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776707.402217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776707.402798:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775424 00000100:00100000:1.0:1789776707.402809:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775424 00000100:00100000:1.0:1789776707.402890:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1789776707.402901:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775424:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1789776707.402937:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776707.403055:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775424:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 154us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.403063:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:3.0:1789776707.403547:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776707.405689:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776707.405783:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775552 00000100:00100000:1.0:1789776707.405795:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775552 00000100:00100000:1.0:1789776707.405870:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1789776707.405881:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775552:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1789776707.405914:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789776707.405999:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff49a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15008:x1876716432775552:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.406007:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:3.0:1789776707.406220:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789776707.618868:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789776707.621916:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 46b2d271-3290-4278-a9ba-b0b58b3db4ff 00000001:00080000:2.0:1789776707.621931:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1789776707.659978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.660085:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775680 00000100:00100000:3.0:1789776707.660095:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775680 00000100:00100000:3.0:1789776707.660162:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:3.0:1789776707.660172:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+10:15039:x1876716432775680:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789776707.660202:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776707.660220:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb885ff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5bb7 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776707.660248:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb885ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bb7 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776707.660259:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217e200/0xf13b8042cb885ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bb7 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776707.660268:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217e200, rc 0) 00000100:00100000:3.0:1789776707.660329:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432775680:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 158us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.660337:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1789776707.671186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.671318:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775808 00000100:00100000:3.0:1789776707.671329:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775808 00000100:00100000:3.0:1789776707.671391:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1789776707.671402:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432775808:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789776707.671646:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432775808:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 246us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.671655:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:0.0:1789776707.678223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776707.678331:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432775936 00000100:00100000:2.0:1789776707.678343:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432775936 00000100:00100000:2.0:1789776707.678402:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1789776707.678413:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432775936:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789776707.678624:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432775936:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 211us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.678633:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:1.0:1789776707.701830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.702206:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776064 00000100:00100000:0.0:1789776707.702217:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776064 00000100:00100000:0.0:1789776707.702278:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1789776707.702288:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776064:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776707.702449:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776064:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 161us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.702457:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1789776707.746732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.746841:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776192 00000100:00100000:3.0:1789776707.746851:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776192 00000100:00100000:3.0:1789776707.746915:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1789776707.746927:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776192:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776707.747099:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776192:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.747115:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:1.0:1789776707.750727:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776707.751046:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776320 00000100:00100000:2.0:1789776707.751058:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776320 00000100:00100000:2.0:1789776707.751253:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:2.0:1789776707.751265:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776320:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776707.751455:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15047:x1876716432776320:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 191us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.751463:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1789776707.756211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.756588:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776448 00000100:00100000:0.0:1789776707.756598:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776448 00000100:00100000:0.0:1789776707.756788:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1789776707.756799:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+11:15039:x1876716432776448:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776707.756818:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776707.756837:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdf600/0xf13b8042cb885ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5be8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.756867:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdf600/0xf13b8042cb885ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5be8 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.756879:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdf600/0xf13b8042cb885ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5be8 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.756906:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf600, rc 0) 00000100:00100000:0.0:1789776707.756973:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+12:15039:x1876716432776448:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 176us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.756981:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:2.0:1789776707.763303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.763638:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776576 00000100:00100000:0.0:1789776707.763648:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776576 00000100:00100000:3.0:1789776707.763932:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1789776707.763946:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+12:15039:x1876716432776576:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789776707.763980:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789776707.764008:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789776707.764012:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789776707.764015:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789776707.764018:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789776707.764020:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789776707.767238:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+12:15039:x1876716432776576:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 3286us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.767252:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1789776707.771963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.772211:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776704 00000100:00100000:0.0:1789776707.772220:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776704 00000100:00100000:0.0:1789776707.772329:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:0.0:1789776707.772340:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+12:15039:x1876716432776704:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776707.772371:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776707.772389:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5bef expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.772419:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.772430:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776707.772440:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfc00, rc 0) 00000100:00100000:0.0:1789776707.772535:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15039:x1876716432776704:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 196us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.772543:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1789776707.774987:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776707.775946:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776832 00000100:00100000:2.0:1789776707.775972:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776832 00000100:00100000:2.0:1789776707.776027:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:2.0:1789776707.776037:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15039:x1876716432776832:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776707.776253:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15039:x1876716432776832:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 216us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.776260:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1789776707.779137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776707.779267:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432776960 00000100:00100000:2.0:1789776707.779276:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432776960 00000100:00100000:2.0:1789776707.779373:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:2.0:1789776707.779384:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15039:x1876716432776960:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789776707.779573:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15039:x1876716432776960:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 190us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.779581:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:3.0:1789776707.782942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.784125:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777088 00000100:00100000:0.0:1789776707.784139:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777088 00000100:00100000:0.0:1789776707.784208:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:0.0:1789776707.784218:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15050:x1876716432777088:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776707.784381:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15050:x1876716432777088:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 164us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.784389:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1789776707.791557:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.793849:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777216 00000100:00100000:0.0:1789776707.793864:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777216 00000100:00100000:0.0:1789776707.793934:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:0.0:1789776707.793944:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15050:x1876716432777216:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776707.794117:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:15050:x1876716432777216:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 173us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.794126:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:3.0:1789776707.804756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.804845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776707.805155:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777344 00000100:00100000:1.0:1789776707.805166:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777344 00000100:00100000:1.0:1789776707.805209:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777600 00000100:00100000:1.0:1789776707.805212:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777600 00000100:00100000:1.0:1789776707.805241:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1789776707.805250:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2410:x1876716432777344:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789776707.805284:0:18719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 61ebe720-9c2b-4296-9269-a6a3ff3a08d8@192.168.204.27@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1789776707.805326:0:18719:0:(genops.c:1385:class_connect()) connect: client 61ebe720-9c2b-4296-9269-a6a3ff3a08d8, cookie 0xf13b8042cb886008 00000004:00100000:1.0:1789776707.805353:0:18719:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789776707.805451:0:18719:0:(import.c:65:import_set_state_nolock()) ffff8a5cf084a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776707.805605:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1789776707.805612:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1876716432777600:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789776707.805630:0:17190:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 61ebe720-9c2b-4296-9269-a6a3ff3a08d8@192.168.204.27@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1789776707.805654:0:17190:0:(genops.c:1385:class_connect()) connect: client 61ebe720-9c2b-4296-9269-a6a3ff3a08d8, cookie 0xf13b8042cb88600f 00000004:00100000:0.0:1789776707.805667:0:17190:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789776707.806560:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2410:x1876716432777344:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 1305us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.806570:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00080000:0.0:1789776707.816314:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5ceb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776707.816457:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2410:x1876716432777600:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 10837us (11605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.816469:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1789776707.816700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776707.816806:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777856 00000100:00100000:2.0:1789776707.816816:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777856 00000100:00100000:2.0:1789776707.816879:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1789776707.816889:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432777856:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789776707.816925:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789776707.832764:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432777856:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 15862us (16050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.832780:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00080000:2.0:1789776707.832854:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776707.834384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.834455:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777472 00000100:00100000:3.0:1789776707.834466:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777472 00000100:00100000:2.0:1789776707.834552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.834560:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1789776707.834574:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:0:x1876716432777472:12345-192.168.204.27@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789776707.834579:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777728 00000100:00100000:2.0:1789776707.834584:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777728 00000004:00000024:3.0:1789776707.834606:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1789776707.834621:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789776707.834653:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1789776707.834661:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:0:x1876716432777728:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789776707.834682:0:18719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789776707.834738:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:0:x1876716432777728:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.834745:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1789776707.835580:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:0:x1876716432777472:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 1005us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.835589:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1789776707.845162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.845815:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432777984 00000100:00100000:3.0:1789776707.845827:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432777984 00000100:00100000:3.0:1789776707.845882:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1789776707.846016:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432777984:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789776707.846158:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432777984:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 266us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.862964:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776707.864015:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864111:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864191:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.864195:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778496 00000100:00100000:3.0:1789776707.864205:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778496 00000100:00100000:0.0:1789776707.864209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.864243:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779008 00000100:00100000:0.0:1789776707.864246:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779008 00000100:00100000:3.0:1789776707.864248:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:3.0:1789776707.864257:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2413:x1876716432778496:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776707.864272:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778880 00000100:00100000:0.0:1789776707.864274:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778880 00000100:00100000:0.0:1789776707.864284:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778112 00000100:00100000:0.0:1789776707.864286:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778112 00000100:00100000:0.0:1789776707.864296:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:0.0:1789776707.864301:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2413:x1876716432779008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776707.864322:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2413:x1876716432778496:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.864326:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2413:x1876716432779008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.864330:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1789776707.864331:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:0.0:1789776707.864342:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776707.864348:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2413:x1876716432778880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776707.864371:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2413:x1876716432778880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.864376:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1789776707.864380:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2410:x1876716432778112:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789776707.864406:0:18695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 61ebe720-9c2b-4296-9269-a6a3ff3a08d8@192.168.204.27@tcp t0 exp 0000000000000000 cur 529 last 0 00000100:00100000:1.0:1789776707.864420:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778368 00000100:00100000:1.0:1789776707.864424:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778368 00000100:00100000:1.0:1789776707.864454:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1789776707.864460:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432778368:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789776707.864533:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432778368:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.864541:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000020:00000080:3.0:1789776707.864600:0:18695:0:(genops.c:1385:class_connect()) connect: client 61ebe720-9c2b-4296-9269-a6a3ff3a08d8, cookie 0xf13b8042cb886016 00002000:00100000:3.0:1789776707.864613:0:18695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 61ebe720-9c2b-4296-9269-a6a3ff3a08d8/ffff8a5cf514d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776707.864625:0:18695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789776707.864666:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778752 00000100:00100000:2.0:1789776707.864681:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778752 00002000:00080000:3.0:1789776707.864714:0:18695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789776707.864714:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778624 00000100:00100000:2.0:1789776707.864716:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778624 00000100:00100000:2.0:1789776707.864740:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00080000:3.0:1789776707.864741:0:18695:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5148000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776707.864746:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2413:x1876716432778752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776707.864767:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2410:x1876716432778112:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 385us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.864811:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1789776707.864819:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2413:x1876716432778624:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1789776707.864853:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2413:x1876716432778624:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776707.864859:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1789776707.865007:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2413:x1876716432778752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776707.865016:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1789776707.865099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776707.865553:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1789776707.865570:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432778240 00000100:00100000:0.0:1789776707.865575:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432778240 00000100:00100000:0.0:1789776707.865590:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1789776707.865595:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1876716432778240:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789776707.865617:0:18697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 61ebe720-9c2b-4296-9269-a6a3ff3a08d8@192.168.204.27@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1789776707.865638:0:18697:0:(genops.c:1385:class_connect()) connect: client 61ebe720-9c2b-4296-9269-a6a3ff3a08d8, cookie 0xf13b8042cb88601d 00002000:00100000:0.0:1789776707.865645:0:18697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 61ebe720-9c2b-4296-9269-a6a3ff3a08d8/ffff8a5cf5ce8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789776707.865661:0:18697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789776707.865738:0:18697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789776707.865758:0:18697:0:(import.c:65:import_set_state_nolock()) ffff8a5cf5cea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776707.865946:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2410:x1876716432778240:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 348us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776707.865955:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1789776707.868702:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776707.877857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776707.877982:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779136 00000100:00100000:3.0:1789776707.877992:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779136 00000100:00100000:3.0:1789776707.878047:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1789776707.878058:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432779136:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789776707.878148:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789776707.878244:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15039:x1876716432779136:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 187us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776707.878252:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1789776708.140812:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776708.140961:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779264 00000100:00100000:1.0:1789776708.140970:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779264 00000100:00100000:1.0:1789776708.141040:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1789776708.141050:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15073:x1876716432779264:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1789776708.141072:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776708.141096:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb886024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c20 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141169:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141182:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141194:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776708.141237:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789776708.141240:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776708.141259:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141287:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb886024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141309:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776708.141329:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:1.0:1789776708.141332:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776708.141352:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1e00, rc 0) 00000100:00100000:1.0:1789776708.141434:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+7:15073:x1876716432779264:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 386us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776708.141441:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:3.0:1789776708.644385:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776709.669510:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776709.669537:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449624704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789776709.669605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776709.669667:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624704 00000100:00100000:2.0:1789776709.669675:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624704 00000100:00100000:2.0:1789776709.669731:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776709.669741:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449624704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776709.669769:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789776709.669824:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449624704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776709.669831:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789776709.669851:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776709.669889:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449624704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789776709.669965:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776710.178755:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776710.178780:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449624832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776710.178855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776710.178919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449624960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776710.178967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776710.179016:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624832 00000100:00100000:1.0:1789776710.179024:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624832 00000100:00100000:2.0:1789776710.179043:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449624960 00000100:00100000:2.0:1789776710.179047:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449624960 00000100:00100000:1.0:1789776710.179120:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789776710.179129:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449624832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789776710.179167:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789776710.179221:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449624832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776710.179228:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789776710.179244:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776710.179250:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449624960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789776710.179264:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789776710.179270:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449624832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776710.179290:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449624960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776710.179295:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789776710.179295:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449624960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789776710.690892:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776710.691362:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776710.691383:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449625088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776710.691459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776710.691578:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625088 00000100:00100000:1.0:1789776710.691586:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625088 00000100:00100000:1.0:1789776710.691659:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789776710.691663:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776710.691670:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449625088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776710.691700:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776710.691748:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449625088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776710.691755:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776710.692284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449625088:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789776710.696555:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 61ebe720-9c2b-4296-9269-a6a3ff3a08d8 00000001:00100000:2.0:1789776710.696568:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 46b2d271-3290-4278-a9ba-b0b58b3db4ff 00000001:00100000:2.0:1789776710.697057:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 61ebe720-9c2b-4296-9269-a6a3ff3a08d8 00000001:00100000:2.0:1789776710.697064:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 46b2d271-3290-4278-a9ba-b0b58b3db4ff 00000001:00100000:2.0:1789776710.699251:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 61ebe720-9c2b-4296-9269-a6a3ff3a08d8 00000001:00100000:2.0:1789776710.699263:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 46b2d271-3290-4278-a9ba-b0b58b3db4ff 00000001:02000400:1.0:1789776711.087734:0:20068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789776711.715171:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776711.715283:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776711.715392:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776711.715474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776711.715819:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625216 00000100:00100000:2.0:1789776711.715826:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625216 00000100:00100000:2.0:1789776711.715894:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776711.715906:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449625216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776711.715935:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789776711.715986:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449625216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776711.716009:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776711.716051:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789776711.716074:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449625216:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789776711.716176:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776711.716802:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449625344:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.716845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.716880:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449625856:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.716904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.716922:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449626368:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.716958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.716981:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789776711.716986:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449625472:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.717029:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449625984:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.717065:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449626496:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776711.717197:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449625600:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.717222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776711.717241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449626112:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.717259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776711.717273:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449626624:0@lo:400:kworker.0 00000100:00100000:3.0:1789776711.717389:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625344 00000100:00100000:3.0:1789776711.717395:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625344 00000100:00100000:3.0:1789776711.717447:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789776711.717455:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449625344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776711.717516:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449625344:12345-0@lo:400:kworker.0 Request processed in 61us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776711.717522:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789776711.717570:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625856 00000100:00100000:3.0:1789776711.717575:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625856 00000100:00100000:0.0:1789776711.717715:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449625344:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449625728:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.717800:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449626240:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.717835:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449626752:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.717875:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626368 00000100:00100000:0.0:1789776711.717879:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626368 00000100:00100000:0.0:1789776711.717907:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626496 00000100:00100000:0.0:1789776711.717910:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626496 00000100:00100000:0.0:1789776711.717923:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625728 00000100:00100000:0.0:1789776711.717925:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625728 00000100:00100000:0.0:1789776711.717935:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626240 00000100:00100000:0.0:1789776711.717937:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626240 00000100:00100000:0.0:1789776711.717945:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626752 00000100:00100000:0.0:1789776711.717946:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626752 00000100:00100000:0.0:1789776711.717960:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789776711.717966:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449626368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.717999:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876716449626368:12345-0@lo:400:kworker.0 Request processed in 34us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776711.718004:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625984 00000100:00100000:0.0:1789776711.718005:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776711.718007:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625984 00000100:00100000:0.0:1789776711.718017:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789776711.718021:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449626496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776711.718032:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625600 00000100:00100000:1.0:1789776711.718034:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625600 00000100:00100000:1.0:1789776711.718045:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626112 00000100:00100000:1.0:1789776711.718047:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626112 00000100:00100000:0.0:1789776711.718048:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876716449626496:12345-0@lo:400:kworker.0 Request processed in 26us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.718054:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789776711.718060:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776711.718062:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776711.718065:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449625984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.718073:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449625728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776711.718234:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449625472 00000100:00100000:3.0:1789776711.718238:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449625472 00000100:00100000:3.0:1789776711.718253:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789776711.718259:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449625856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776711.719897:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449625984:12345-0@lo:400:kworker.0 Request processed in 1827us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776711.719910:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776711.719941:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776711.719952:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449625600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.719960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776711.720030:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876716449625728:12345-0@lo:400:kworker.0 Request processed in 1954us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.720040:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789776711.720058:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626624 00000100:00100000:0.0:1789776711.720064:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626624 00000100:00100000:2.0:1789776711.720100:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789776711.720113:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449626240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720118:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776711.720129:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449626752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.720161:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876716449626240:12345-0@lo:400:kworker.0 Request processed in 51us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776711.720169:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789776711.720178:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876716449626752:12345-0@lo:400:kworker.0 Request processed in 51us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.720186:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789776711.720197:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776711.720207:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449626624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720220:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776711.720236:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449626880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789776711.720245:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876716449626624:12345-0@lo:400:kworker.0 Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776711.720252:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789776711.720280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776711.720284:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776711.720293:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449626112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789776711.720316:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776711.720321:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776711.720326:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776711.720329:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776711.720344:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449626112:12345-0@lo:400:kworker.0 Request processed in 51us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.720360:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876716449625728:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.720369:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776711.720391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876716449626240:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.720399:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789776711.720410:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd881c380 x1876716449626752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776711.720411:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449625472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720436:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876716449626752:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.720465:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449625472:12345-0@lo:400:kworker.0 Request processed in 57us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.720469:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449626880 00000100:00100000:0.0:1789776711.720473:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449626880 00000100:00100000:0.0:1789776711.720513:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789776711.720526:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449626880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776711.720541:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776711.720577:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449626880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776711.720582:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789776711.720613:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449626880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776711.720635:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449625472:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720644:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449625984:0@lo:400:kworker.0 00010000:00080000:0.0:1789776711.720654:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cd881f100 x1876716449626496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776711.720663:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876716449626496:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720672:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876716449626368:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449626112:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.720730:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876716449626624:0@lo:400:kworker.0 00000100:00100000:2.0:1789776711.720984:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776711.721897:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449625600:12345-0@lo:400:kworker.0 Request processed in 1946us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776711.721908:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776711.722263:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449625856:12345-0@lo:400:kworker.0 Request processed in 4002us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776711.722272:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789776711.722418:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449625856:0@lo:400:kworker.0 00000100:00100000:0.0:1789776711.723021:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449625600:0@lo:400:kworker.0 00000040:00080000:3.0:1789776712.171555:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789776712.738816:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776712.895261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776712.895316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776712.895346:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776712.895359:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779392 00000100:00100000:2.0:1789776712.895373:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779392 00000100:00100000:3.0:1789776712.895377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776712.895394:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779520 00000100:00100000:0.0:1789776712.895401:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779520 00000100:00100000:3.0:1789776712.895416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776712.895452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776712.895460:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:2.0:1789776712.895474:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2412:x1876716432779392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776712.895483:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776712.895565:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776712.895663:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779648 00000100:00100000:0.0:1789776712.895668:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779648 00000100:00100000:0.0:1789776712.895688:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780160 00000100:00100000:0.0:1789776712.895691:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780160 00000100:00100000:0.0:1789776712.895705:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780032 00000100:00100000:0.0:1789776712.895707:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780032 00000100:00100000:0.0:1789776712.895729:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:0.0:1789776712.895757:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2411:x1876716432779520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776712.896010:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2412:x1876716432779392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 538us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776712.896021:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:0.0:1789776712.896027:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2411:x1876716432779520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 269us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776712.896037:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:2.0:1789776712.896091:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1789776712.896099:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432779648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776712.896185:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1789776712.896194:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432780160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776712.896223:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432780160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776712.896230:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1789776712.896242:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1789776712.896248:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432780032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776712.896270:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432780032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776712.896276:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00080000:0.0:1789776712.896294:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789776712.896299:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776712.896309:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779904 00000100:00100000:0.0:1789776712.896313:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779904 00000100:00100000:0.0:1789776712.896437:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780416 00000100:00100000:0.0:1789776712.896441:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780416 00000100:00100000:0.0:1789776712.896618:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432779776 00000100:00100000:0.0:1789776712.896623:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432779776 00000100:00100000:2.0:1789776712.896650:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432779648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 548us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776712.896654:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1789776712.896666:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1789776712.896668:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432779904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776712.896678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776712.896698:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780288 00000100:00100000:2.0:1789776712.896703:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780288 00000100:00100000:0.0:1789776712.896708:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432779904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776712.896717:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1789776712.896734:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1789776712.896735:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2412:x1876716432780416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776712.896735:0:19184:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789776712.896747:0:19184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789776712.896757:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1789776712.896767:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432779776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776712.896774:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2412:x1876716432780416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 46us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776712.896782:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1789776712.896799:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1789776712.896806:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432780288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776712.896835:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432780288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776712.896852:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1789776712.897233:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432779776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 467us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776712.897240:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:0.0:1789776712.897264:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776712.897268:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789776713.766445:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 61ebe720-9c2b-4296-9269-a6a3ff3a08d8 00010000:00010000:1.0:1789776713.772672:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776714.514865:0:20217:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd865855c0 20000000:00000080:0.0:1789776714.514893:0:20217:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a5cc40b9400 uarg=0000000000000000 20000000:01000000:0.0:1789776714.515452:0:20217:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789776714.515461:0:20217:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789776714.515467:0:20217:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789776714.517117:0:20218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789776714.517370:0:20217:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789776714.524101:0:20217:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789776714.524140:0:20217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524161:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524170:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524177:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524184:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524193:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524200:0:20217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524208:0:20217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524260:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524299:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 12 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.524317:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627008:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776714.524489:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524531:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 12 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.524558:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627136:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776714.524595:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.524603:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.524612:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627264:0@lo:104: 00000100:00100000:3.0:1789776714.525326:0:20217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776714.525388:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.525399:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 23 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.525409:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627392:0@lo:104: 00000100:00100000:3.0:1789776714.525434:0:20217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776714.525483:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.525506:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776714.525510:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627264 00000100:00100000:3.0:1789776714.525514:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627520:0@lo:104: 00000100:00100000:1.0:1789776714.525517:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627264 00000100:00100000:3.0:1789776714.525534:0:20217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776714.525561:0:20217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776714.525566:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627392 00010000:00010000:3.0:1789776714.525569:0:20217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776714.525575:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627392 00000100:00100000:3.0:1789776714.525577:0:20217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627648:0@lo:104: 00000100:00100000:1.0:1789776714.525590:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627520 00000100:00100000:1.0:1789776714.525593:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627520 00000100:00100000:1.0:1789776714.525606:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776714.525609:0:20217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776714.525615:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+5:20217:x1876716449627264:12345-0@lo:104: 00000100:00100000:3.0:1789776714.525618:0:20217:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1789776714.525628:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525689:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776714.525696:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+5:20217:x1876716449627264:12345-0@lo:104: Request processed in 82us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776714.525703:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776714.525718:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627648 00000100:00100000:1.0:1789776714.525721:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627648 00000100:00100000:1.0:1789776714.525741:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776714.525747:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+5:20217:x1876716449627392:12345-0@lo:104: 00010000:00010000:1.0:1789776714.525755:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525790:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776714.525795:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+5:20217:x1876716449627392:12345-0@lo:104: Request processed in 49us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776714.525801:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776714.525813:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776714.525818:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+4:20217:x1876716449627520:12345-0@lo:104: 00010000:00010000:1.0:1789776714.525825:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525856:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776714.525868:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+4:20217:x1876716449627520:12345-0@lo:104: Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776714.525873:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776714.525886:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776714.525892:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+3:20217:x1876716449627648:12345-0@lo:104: 00010000:00010000:1.0:1789776714.525900:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525927:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789776714.525931:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:086c90d1-9383-41b8-afea-b47b6abf291d+3:20217:x1876716449627648:12345-0@lo:104: Request processed in 40us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776714.525936:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789776714.525952:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789776714.525958:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525965:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c1600 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776714.525970:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.525978:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776714.525985:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776714.525991:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776714.526018:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526034:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776714.526054:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526061:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c1600/0xf13b8042cb885e6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885e72 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526074:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789776714.526078:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526083:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde000 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776714.526086:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526093:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776714.526100:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776714.526105:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776714.526117:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526123:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776714.526135:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526141:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc3cde000/0xf13b8042cb885d0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885d14 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526156:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776714.526159:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526164:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256e00 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776714.526167:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526174:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776714.526180:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776714.526185:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776714.526198:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526204:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776714.526210:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526216:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5cfc256e00/0xf13b8042cb885cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cd5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526225:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776714.526228:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526244:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc31a3200 already unused, calling callback (ffffffffc11fbc20) 10000000:00010000:1.0:1789776714.526247:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526255:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776714.526260:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776714.526265:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776714.526281:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526286:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776714.526293:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526298:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff8a5bc31a3200/0xf13b8042cb885cc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf13b8042cb885cc7 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.526312:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776714.526314:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776714.526315:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776714.526322:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776714.526342:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449628160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776714.526385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776714.526406:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776714.526412:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449627776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776714.526444:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776714.526543:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776714.526556:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628160 00000100:00100000:2.0:1789776714.526562:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628160 00010000:00010000:2.0:1789776714.526589:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 24 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776714.526622:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627776 00000100:00100000:2.0:1789776714.526625:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627776 00010000:00010000:2.0:1789776714.526650:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 25 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776714.526671:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776714.526679:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+25:3643:x1876716449628160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776714.526692:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776714.526698:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 25 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.526709:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 25 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.526726:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776714.526766:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+25:3643:x1876716449628160:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776714.526773:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776714.526787:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776714.526793:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449627776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776714.526801:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776714.526805:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 24 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.526813:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 24 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.526822:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776714.526852:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+24:3643:x1876716449627776:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776714.526858:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776714.526892:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449627776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776714.526901:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:086c90d1-9383-41b8-afea-b47b6abf291d:3643:1876716449628160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776714.526998:0:20217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5cc79c1a00/0xf13b8042cb885e72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885e6b expref: 23 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.527010:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627264:0@lo:104: 00000100:00100000:3.0:1789776714.527021:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627392:0@lo:104: 00000100:00100000:3.0:1789776714.527028:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627520:0@lo:104: 00010000:00010000:3.0:1789776714.527036:0:20217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cde800/0xf13b8042cb885cc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885cc0 expref: 22 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.527043:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627648:0@lo:104: 00000100:00100000:0.0:1789776714.527364:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449627904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776714.527453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776714.527542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776714.527549:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449628032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776714.527580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776714.527848:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449627904 00000100:00100000:3.0:1789776714.527856:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449627904 00000100:00100000:2.0:1789776714.527857:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628032 00000100:00100000:2.0:1789776714.527860:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628032 00010000:00010000:3.0:1789776714.527882:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 23 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.527882:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776714.527902:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776714.527908:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+23:3645:x1876716449628032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776714.527917:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776714.527921:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.527931:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.527948:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cde600/0xf13b8042cb885cd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885cce expref: 23 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776714.527957:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776714.528005:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:086c90d1-9383-41b8-afea-b47b6abf291d+22:3645:x1876716449628032:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776714.528054:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776714.528062:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf08e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+22:3645:x1876716449627904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776714.528069:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776714.528073:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 22 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.528080:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 22 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.528089:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc31a3000/0xf13b8042cb885d14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf13b8042cb885d0d expref: 22 pid: 17185 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.528096:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776714.528127:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf08e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:086c90d1-9383-41b8-afea-b47b6abf291d+21:3645:x1876716449627904:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776714.528133:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776714.528243:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776714.528352:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449628032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776714.528368:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:086c90d1-9383-41b8-afea-b47b6abf291d:3645:1876716449627904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776714.533965:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627008:192.168.204.27@tcp:104: 00000100:00100000:0.0:1789776714.540899:0:20217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20217:1876716449627136:192.168.204.27@tcp:104: 00010000:00010000:0.0:1789776714.540961:0:20217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776714.542289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776714.542397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776714.542606:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780672 00000100:00100000:3.0:1789776714.542607:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780544 00000100:00100000:1.0:1789776714.542627:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780672 00000100:00100000:3.0:1789776714.542628:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780544 00010000:00010000:1.0:1789776714.542707:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.542708:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776714.542765:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1789776714.542779:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b16530f-c033-42a8-8d5b-836bd948ad72+14:2412:x1876716432780672:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776714.542799:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776714.542806:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.542819:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.543076:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cde200/0xf13b8042cb885fc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5b7f expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776714.543197:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1789776714.543209:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b16530f-c033-42a8-8d5b-836bd948ad72+14:2412:x1876716432780544:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776714.543224:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776714.543230:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543256:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543273:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5bc3cdfc00/0xf13b8042cb886001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bef expref: 14 pid: 17184 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543292:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543301:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543316:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543323:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543330:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543337:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543343:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fc00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776714.543347:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543355:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543396:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776714.543406:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776714.543455:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2412:x1876716432780544:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 249us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776714.543463:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00010000:00010000:0.0:1789776714.543531:0:20217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776714.543541:0:20217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776714.543557:0:20217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a5d0217fc00/0xf13b8042cb886032 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776714.543881:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776714.543941:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b16530f-c033-42a8-8d5b-836bd948ad72+11:2412:x1876716432780672:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1162us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776714.543952:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:3.0:1789776714.786913:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776714.787048:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776714.787068:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449628288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776714.787146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776714.787573:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628288 00000100:00100000:2.0:1789776714.787581:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628288 00000100:00100000:2.0:1789776714.787688:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776714.787699:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449628288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789776714.787731:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789776714.787792:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449628288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776714.787799:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776714.787938:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449628288:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789776714.788149:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776715.299040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449628416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789776715.299115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776715.299188:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776715.299198:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449628544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776715.299229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776715.299282:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628416 00000100:00100000:3.0:1789776715.299290:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628416 00000100:00100000:3.0:1789776715.299341:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628544 00000100:00100000:3.0:1789776715.299345:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628544 00000100:00100000:3.0:1789776715.299387:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776715.299399:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449628416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789776715.299437:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789776715.299487:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449628416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776715.299533:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776715.299559:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789776715.299690:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449628544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776715.299720:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789776715.299761:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449628544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776715.299770:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789776715.299861:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449628544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789776715.299885:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449628416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789776715.810931:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776715.810952:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449628672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776715.811025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776715.811118:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628672 00000100:00100000:1.0:1789776715.811125:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628672 00000100:00100000:1.0:1789776715.811176:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789776715.811185:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449628672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776715.811207:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789776715.811245:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876716449628672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776715.811252:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789776715.811271:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776715.811304:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876716449628672:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789776716.130570:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776716.130579:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc2465800 from 13 10000000:01000000:1.0:1789776716.130586:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776716.130633:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.130645:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.130675:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776716.130702:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449628800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.130768:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.130856:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628800 00000100:00100000:2.0:1789776716.130875:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628800 00000100:00100000:2.0:1789776716.130924:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789776716.131307:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+20:17188:x1876716449628800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776716.131323:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776716.131340:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc4b0ae00/0xf13b8042cb886040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb886039 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.131378:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc4b0ae00/0xf13b8042cb886040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb886039 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.131389:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc4b0ae00/0xf13b8042cb886040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb886039 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.131398:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0ae00, rc 0) 00000100:00100000:1.0:1789776716.131454:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776716.131478:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449628800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776716.131510:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb886040 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.131536:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb886040 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776716.131602:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449628928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.132304:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776716.132327:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776716.132358:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449628928 00000100:00100000:1.0:1789776716.132363:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449628928 00000100:00100000:1.0:1789776716.132390:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789776716.132396:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449628928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.132535:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449628928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.132542:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789776716.132581:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449628928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.132625:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.132664:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776716.132692:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776716.132703:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629056 00000100:00100000:1.0:1789776716.132706:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629056 00000100:00100000:1.0:1789776716.132722:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789776716.132727:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.132801:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.132808:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789776716.132849:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.133204:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+21:17188:x1876716449628800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2270us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.133210:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000040:00080000:1.0:1789776716.135382:0:20290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789776716.137361:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789776716.137393:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776716.137403:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb886040 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.137422:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc79c0e00/0xf13b8042cb886039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb886040 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776716.137433:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776716.137435:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc3457800 from 13 10000000:01000000:2.0:1789776716.137438:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776716.137474:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.137482:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.137513:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776716.137544:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.137612:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.137649:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776716.137705:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629184 00000100:00100000:1.0:1789776716.137713:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629184 00000100:00100000:1.0:1789776716.137762:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776716.137771:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+21:17188:x1876716449629184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776716.137785:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776716.137797:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb88604e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb886047 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.137821:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb88604e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb886047 expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.137832:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc79c1600/0xf13b8042cb88604e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb886047 expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776716.137841:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1600, rc 0) 00000100:00100000:1.0:1789776716.137892:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.137898:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789776716.137914:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776716.137928:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88604e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.137938:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88604e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776716.137993:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.138020:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.138040:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776716.139267:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629312 00000100:00100000:2.0:1789776716.139276:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629312 00000100:00100000:2.0:1789776716.139368:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789776716.139377:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.139543:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.139551:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789776716.139632:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.139691:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.139737:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.141370:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629440 00000100:00100000:3.0:1789776716.141379:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629440 00000100:00100000:1.0:1789776716.141387:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc87369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776716.141419:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789776716.141427:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.141639:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.141646:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789776716.142006:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789776716.143195:0:20292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789776716.143653:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789776716.143677:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776716.143689:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88604e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.143707:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0ba00/0xf13b8042cb886047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88604e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776716.143717:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776716.143720:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc378a000 from 13 10000000:01000000:2.0:1789776716.143722:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776716.143755:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.143763:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.143773:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776716.143795:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.143849:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.143923:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5dca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789776716.143962:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629568 00000100:00100000:3.0:1789776716.143969:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629568 00000100:00100000:3.0:1789776716.144042:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789776716.144051:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+22:17188:x1876716449629568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776716.144064:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776716.144076:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217e800/0xf13b8042cb88605c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb886055 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.144098:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217e800/0xf13b8042cb88605c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb886055 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.144108:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217e800/0xf13b8042cb88605c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb886055 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.144115:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217e800, rc 0) 00000100:00100000:3.0:1789776716.144163:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.144170:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789776716.144235:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776716.144249:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88605c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776716.144258:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88605c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776716.144314:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776716.144357:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776716.144466:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4f76540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776716.144582:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629696 00000100:00100000:2.0:1789776716.144587:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629696 00000100:00100000:2.0:1789776716.144608:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789776716.144615:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.144715:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.144723:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789776716.144753:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.144781:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.144822:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.144836:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776716.144848:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629824 00000100:00100000:2.0:1789776716.144851:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629824 00000100:00100000:2.0:1789776716.144866:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789776716.144872:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776716.144946:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.144952:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789776716.144989:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789776716.145767:0:20293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789776716.145988:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789776716.146014:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776716.146025:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88605c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.146034:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5cc4b0b600/0xf13b8042cb886055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88605c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776716.146044:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776716.146047:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a5bc3db5000 from 13 10000000:01000000:3.0:1789776716.146050:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776716.146079:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.146096:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.146105:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776716.146125:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.146168:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.146235:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776716.146267:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449629952 00000100:00100000:2.0:1789776716.146274:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449629952 00000100:00100000:2.0:1789776716.146340:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789776716.146359:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+23:17188:x1876716449629952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776716.146370:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776716.146382:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5cc4b0bc00/0xf13b8042cb88606a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf13b8042cb886063 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.146402:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5cc4b0bc00/0xf13b8042cb88606a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf13b8042cb886063 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.146411:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5cc4b0bc00/0xf13b8042cb88606a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf13b8042cb886063 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.146419:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0bc00, rc 0) 00000100:00100000:2.0:1789776716.146465:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449629952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.146476:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789776716.146649:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cd881d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449629952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776716.146663:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88606a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776716.146671:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf13b8042cb88606a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776716.146726:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449630080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776716.146757:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776716.146863:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4f76600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776716.146908:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630080 00000100:00100000:3.0:1789776716.146912:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630080 00000100:00100000:3.0:1789776716.146938:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789776716.146945:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449630080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.147058:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449630080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.147064:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789776716.147165:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449630080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776716.147191:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449630208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776716.147228:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776716.147283:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc4f76600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776716.147311:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630208 00000100:00100000:3.0:1789776716.147315:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630208 00000100:00100000:3.0:1789776716.147381:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789776716.147388:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449630208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.147472:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:17188:x1876716449630208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.147479:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789776716.147646:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:086c90d1-9383-41b8-afea-b47b6abf291d:17188:1876716449630208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776716.148448:0:20294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789776716.148671:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789776716.148690:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776716.148700:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88606a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776716.148710:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff8a5d0217fe00/0xf13b8042cb886063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf13b8042cb88606a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776716.222851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776716.223294:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780800 00000100:00100000:0.0:1789776716.223305:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780800 00000100:00100000:0.0:1789776716.223378:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1789776716.224106:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+11:14923:x1876716432780800:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776716.224123:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776716.224141:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5bc3cdfa00/0xf13b8042cb886071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c27 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776716.224169:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5bc3cdfa00/0xf13b8042cb886071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c27 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776716.224253:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5bc3cdfa00/0xf13b8042cb886071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c27 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776716.224264:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfa00, rc 0) 00000100:00100000:0.0:1789776716.224332:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf6ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432780800:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 235us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776716.224363:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1789776716.231771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776716.236752:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432780928 00000100:00100000:3.0:1789776716.236767:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432780928 00000100:00100000:3.0:1789776716.236892:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:3.0:1789776716.236902:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432780928:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776716.237273:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432780928:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 371us (5511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.237282:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:2.0:1789776716.250781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776716.251130:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781056 00000100:00100000:1.0:1789776716.251141:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781056 00000100:00100000:1.0:1789776716.251216:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:1.0:1789776716.251229:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432781056:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.251398:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432781056:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 171us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.251408:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1789776716.266573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776716.266648:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781184 00000100:00100000:3.0:1789776716.266658:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781184 00000100:00100000:3.0:1789776716.266722:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1789776716.266732:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+12:14923:x1876716432781184:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776716.266749:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776716.266769:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb886078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c2e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.266800:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb886078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c2e expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.266877:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a5d0217ee00/0xf13b8042cb886078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c2e expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776716.266887:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217ee00, rc 0) 00000100:00100000:3.0:1789776716.266955:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b16530f-c033-42a8-8d5b-836bd948ad72+13:14923:x1876716432781184:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.266962:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1789776716.270601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776716.271113:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781312 00000100:00100000:1.0:1789776716.271123:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781312 00000100:00100000:1.0:1789776716.271392:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:1.0:1789776716.271404:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:14923:x1876716432781312:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.271591:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:14923:x1876716432781312:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 189us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.271600:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:3.0:1789776716.278192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776716.278336:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781440 00000100:00100000:1.0:1789776716.279264:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781440 00000100:00100000:1.0:1789776716.279323:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:1.0:1789776716.279333:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:14923:x1876716432781440:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776716.280176:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:14923:x1876716432781440:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 838us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.280453:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000040:00080000:3.0:1789776716.324195:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789776716.835141:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449630464:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449630976:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449631488:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835371:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789776716.835376:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449630592:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835424:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449631104:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835463:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449631616:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.835560:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630464 00000100:00100000:3.0:1789776716.835568:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630464 00000100:00100000:3.0:1789776716.835606:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630976 00000100:00100000:3.0:1789776716.835608:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630976 00000100:00100000:3.0:1789776716.835625:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789776716.835633:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449630464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835687:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449630464:12345-0@lo:400:kworker.0 Request processed in 55us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.835694:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789776716.835710:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776716.835716:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449630976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835742:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449630976:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.835748:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776716.835773:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631488 00000100:00100000:3.0:1789776716.835776:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631488 00000100:00100000:3.0:1789776716.835804:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631616 00000100:00100000:3.0:1789776716.835807:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631616 00000100:00100000:3.0:1789776716.835827:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789776716.835834:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449631488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835864:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449631488:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.835871:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789776716.835883:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776716.835888:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449631616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.835911:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876716449631616:12345-0@lo:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.835917:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776716.835932:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630592 00000100:00100000:3.0:1789776716.835936:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630592 00000100:00100000:3.0:1789776716.835954:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631104 00000100:00100000:3.0:1789776716.835957:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631104 00000100:00100000:3.0:1789776716.835975:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776716.835981:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd881e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449630592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836009:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd881e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449630592:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.836015:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776716.836025:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776716.836031:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cc4343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449631104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836051:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cc4343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449631104:12345-0@lo:400:kworker.0 Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776716.836066:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776716.836216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449630592:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836227:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449631104:0@lo:400:kworker.0 00010000:00080000:3.0:1789776716.836238:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cfc397480 x1876716449631616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776716.836247:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876716449631616:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836257:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449630464:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449630976:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.836272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449631488:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836485:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449630336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836577:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449630848:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449631360:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449631872:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836687:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789776716.836692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449630720:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf08e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449631232:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836754:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449631744:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776716.836804:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630848 00000100:00100000:2.0:1789776716.836809:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630848 00000100:00100000:2.0:1789776716.836829:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631360 00000100:00100000:2.0:1789776716.836831:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631360 00000100:00100000:2.0:1789776716.836841:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631872 00000100:00100000:2.0:1789776716.836843:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631872 00000100:00100000:2.0:1789776716.836855:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631744 00000100:00100000:2.0:1789776716.836857:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631744 00000100:00100000:2.0:1789776716.836871:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789776716.836878:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449630848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836916:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449630848:12345-0@lo:400:kworker.0 Request processed in 39us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.836921:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789776716.836936:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776716.836942:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449631360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.836966:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449631360:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.836971:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776716.836982:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776716.836987:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449631872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837010:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449631872:12345-0@lo:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.837015:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776716.837026:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776716.837032:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449631744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837057:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449631744:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.837068:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776716.837089:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630720 00000100:00100000:2.0:1789776716.837093:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630720 00000100:00100000:2.0:1789776716.837108:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449631232 00000100:00100000:2.0:1789776716.837110:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449631232 00000100:00100000:2.0:1789776716.837121:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776716.837126:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449630720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837156:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449630720:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.837162:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776716.837173:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776716.837186:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837210:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449631232:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776716.837216:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789776716.837282:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776716.837311:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449630720:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837321:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449631232:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cfc396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449631744:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837353:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449630848:0@lo:400:kworker.0 00000100:00100000:2.0:1789776716.837362:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449631360:0@lo:400:kworker.0 00010000:00080000:2.0:1789776716.837372:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf089ea00 x1876716449631872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776716.837381:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449631872:0@lo:400:kworker.0 00000100:00100000:3.0:1789776716.837606:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776716.837637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776716.837665:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776716.837671:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449632000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789776716.837691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776716.837723:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776716.837727:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776716.837730:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789776716.837733:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776716.837800:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449632128 00000100:00100000:1.0:1789776716.837806:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449632128 00000100:00100000:0.0:1789776716.837820:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449630336 00000100:00100000:0.0:1789776716.837826:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449630336 00000100:00100000:1.0:1789776716.837832:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449632000 00000100:00100000:1.0:1789776716.837837:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449632000 00000100:00100000:1.0:1789776716.837858:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776716.837867:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449632128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776716.837869:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789776716.837881:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:3644:x1876716449630336:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789776716.837896:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776716.837931:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:086c90d1-9383-41b8-afea-b47b6abf291d+24:3644:x1876716449630336:12345-0@lo:400:kworker.0 Request processed in 52us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776716.837939:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789776716.837953:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776716.837969:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776716.837985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf08e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449630336:0@lo:400:kworker.0 00000100:00100000:1.0:1789776716.837989:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776716.837999:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449632000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789776716.838011:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776716.838027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776716.838050:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449632000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776716.838052:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449632000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789776716.838064:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776717.592578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.592853:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781568 00000100:00100000:2.0:1789776717.592871:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781568 00000100:00100000:2.0:1789776717.592965:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776717.592979:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:15589:x1876716432781568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776717.593008:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.593039:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88607f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c35 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593134:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593153:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593167:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593186:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593193:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593200:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593323:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0aa00/0xf13b8042cb886094 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593332:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0aa00/0xf13b8042cb886094 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593365:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0aa00/0xf13b8042cb886094 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776717.593405:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789776717.593409:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776717.593456:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0aa00/0xf13b8042cb886094 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593469:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593474:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593481:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593558:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.593563:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593571:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593585:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:2.0:1789776717.593589:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.593593:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593599:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb886086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593625:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593631:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593637:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593642:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.593645:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593651:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593658:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776717.593660:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.593663:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593668:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb88608d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593705:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88607f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c35 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593718:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0aa00/0xf13b8042cb886094 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c35 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.593735:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5bc2121a00) 00010000:00010000:2.0:1789776717.593738:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776717.593740:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0aa00, rc 0) 00000100:00100000:2.0:1789776717.593821:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15589:x1876716432781568:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 845us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.593829:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00080000:0.0:1789776717.595012:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776717.610905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.611033:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781696 00000100:00100000:2.0:1789776717.611048:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781696 00000100:00100000:2.0:1789776717.611130:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1789776717.611144:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15589:x1876716432781696:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789776717.611254:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15589:x1876716432781696:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 113us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.611263:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1789776717.614647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.614823:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432781952 00000100:00100000:2.0:1789776717.614837:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432781952 00000100:00100000:2.0:1789776717.614921:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776717.614932:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:15589:x1876716432781952:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776717.614961:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.614987:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88609b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c3c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.615134:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.615151:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.615183:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.616943:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.616982:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.616994:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617134:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0ac00/0xf13b8042cb8860b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617143:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0ac00/0xf13b8042cb8860b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617149:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0ac00/0xf13b8042cb8860b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776717.617160:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789776717.617337:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617345:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617351:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617357:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.617367:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617375:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617388:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a5bc2121a00) 00010000:00010000:2.0:1789776717.617391:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.617395:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617401:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617413:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617418:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617423:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617428:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.617430:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617435:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617441:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776717.617443:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.617453:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.617458:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.621525:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88609b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c3c expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.621554:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0ac00/0xf13b8042cb8860b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c3c expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.621564:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5bc2121900) 00010000:00010000:2.0:1789776717.621567:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.621570:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0ac00, rc 0) 00000100:00100000:2.0:1789776717.621641:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15589:x1876716432781952:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 6711us (7010us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789776717.621650:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1789776717.625148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.625291:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782080 00000100:00100000:2.0:1789776717.625301:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782080 00000100:00100000:2.0:1789776717.625369:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1789776717.625381:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15589:x1876716432782080:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789776717.625524:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15589:x1876716432782080:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.625532:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1789776717.631855:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776717.632272:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782208 00000100:00100000:3.0:1789776717.632283:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782208 00000100:00100000:3.0:1789776717.632408:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1789776717.632418:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:15589:x1876716432782208:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789776717.632571:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789776717.634666:0:17190:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2186us 00000100:00100000:3.0:1789776717.658966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.659300:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782336 00000100:00100000:2.0:1789776717.659422:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782336 00000100:00100000:2.0:1789776717.659550:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1789776717.659562:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15595:x1876716432782336:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776717.659603:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.659640:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c43 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659728:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659747:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659761:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659783:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659791:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659798:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659916:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659925:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659932:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659939:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.659951:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659960:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659975:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:2.0:1789776717.659978:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.659983:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.659989:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660003:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660009:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660015:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660020:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.660023:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660043:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660051:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776717.660053:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.660063:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660070:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660111:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c43 expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660123:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:2.0:1789776717.660126:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.660130:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c43 expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.660140:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0b400, rc 0) 00000100:00100000:2.0:1789776717.660227:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15595:x1876716432782336:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 666us (1277us total) trans 0 rc 301/301 00000100:00100000:2.0:1789776717.660235:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1789776717.665419:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:15589:x1876716432782208:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 32985us (33560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776717.665440:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1789776717.667529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776717.667615:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782464 00000100:00100000:1.0:1789776717.667629:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782464 00000100:00100000:1.0:1789776717.667691:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1789776717.667702:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15595:x1876716432782464:12345-192.168.204.27@tcp:700:lfs.0 00000100:00100000:1.0:1789776717.667809:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15595:x1876716432782464:12345-192.168.204.27@tcp:700:lfs.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776717.667824:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1789776717.671348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.671399:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782720 00000100:00100000:2.0:1789776717.671411:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782720 00000100:00100000:2.0:1789776717.671478:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1789776717.671533:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:15595:x1876716432782720:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1789776717.671593:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776717.671634:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb885fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5bb0 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.671666:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:2.0:1789776717.671671:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776717.671742:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.671758:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.671768:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.671812:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.671826:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 5 pid: 17192 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776717.671842:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17191:1876716449632256:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776717.671933:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc521f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776717.674923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776717.675012:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782848 00000100:00100000:0.0:1789776717.675022:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782848 00010000:00010000:0.0:1789776717.675087:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 6 pid: 17192 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776717.675131:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1789776717.675143:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432782848:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776717.675160:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776717.675166:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 6 pid: 17192 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.675193:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 6 pid: 17192 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.675219:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:0.0:1789776717.675224:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.675234:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.675241:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.675259:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776717.675308:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432782848:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 168us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776717.675330:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:1.0:1789776717.675395:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776717.677650:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb88602b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c20 expref: 5 pid: 17192 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776717.677676:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17191:1876716449632256:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776717.677701:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.677711:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.677718:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.677764:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.677778:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.677787:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679166:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679186:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679196:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776717.679213:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000990c0438 reply state 0000000015a3d917 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679224:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679231:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:2.0:1789776717.679233:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776717.679236:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789776717.679242:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789776717.679248:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679254:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679268:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679274:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.679278:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679286:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679297:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91ebe00) 00010000:00010000:2.0:1789776717.679299:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.679303:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679309:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8860d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776717.679412:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000990c0438 reply state 0000000015a3d917 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679422:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.679428:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776717.679430:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776717.679432:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789776717.679870:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+10:15595:x1876716432782720:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 8378us (8526us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789776717.679880:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1789776717.755257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776717.755389:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432782976 00000100:00100000:1.0:1789776717.755405:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432782976 00000100:00100000:1.0:1789776717.755581:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1789776717.755594:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+10:15603:x1876716432782976:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:1.0:1789776717.755621:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776717.755646:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb8860e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c4a expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755717:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb8860ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755758:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb8860ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755770:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb8860ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776717.755815:0:18719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789776717.755819:0:18719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789776717.755873:0:18719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb8860ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755899:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1200/0xf13b8042cb8860e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c4a expref: 12 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755918:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c1e00/0xf13b8042cb8860ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c4a expref: 11 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.755927:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:1.0:1789776717.755930:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776717.755933:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1e00, rc 0) 00000100:00100000:1.0:1789776717.756016:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+11:15603:x1876716432782976:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 425us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776717.756024:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1789776717.803258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776717.803475:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432783104 00000100:00100000:0.0:1789776717.803535:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432783104 00000100:00100000:0.0:1789776717.803627:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776717.803639:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:15604:x1876716432783104:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1789776717.803665:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776717.803695:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8860f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c51 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.803782:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb8860fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.803823:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb8860fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.803852:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb8860fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776717.803915:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789776717.803919:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776717.803947:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb8860fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.803978:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf800/0xf13b8042cb8860f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c51 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.804004:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdec00/0xf13b8042cb8860fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c51 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.804013:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:0.0:1789776717.804016:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776717.804020:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdec00, rc 0) 00000100:00100000:0.0:1789776717.804103:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15604:x1876716432783104:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 466us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776717.804112:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1789776717.809163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776717.809440:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432783232 00000100:00100000:3.0:1789776717.809454:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432783232 00000100:00100000:3.0:1789776717.809774:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1789776717.809788:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:15604:x1876716432783232:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776717.809817:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776717.809873:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb886104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c58 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.809971:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.809991:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810008:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810021:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810050:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810057:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810163:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810172:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810179:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776717.810241:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776717.810246:0:17190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776717.810273:0:17190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810287:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810294:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810302:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810308:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776717.810328:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810344:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810359:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:3.0:1789776717.810362:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776717.810367:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810373:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb88610b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810388:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810393:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810399:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810403:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776717.810406:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810413:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810419:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:3.0:1789776717.810422:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776717.810424:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810439:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886112 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810470:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb886104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c58 expref: 8 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810485:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c58 expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.810531:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:3.0:1789776717.810534:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776717.811166:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:3.0:1789776717.811306:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+7:15604:x1876716432783232:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1518us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776717.811334:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1789776717.818749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.819065:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432783360 00000100:00100000:2.0:1789776717.819080:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432783360 00000100:00100000:2.0:1789776717.819188:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1789776717.819201:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:15604:x1876716432783360:12345-192.168.204.27@tcp:900:lfs.0 00000100:00100000:2.0:1789776717.819340:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:15604:x1876716432783360:12345-192.168.204.27@tcp:900:lfs.0 Request processed in 140us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.819350:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00080000:1.0:1789776717.819975:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776717.824378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.824533:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432783616 00000100:00100000:2.0:1789776717.824749:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432783616 00000100:00100000:2.0:1789776717.824847:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:2.0:1789776717.824861:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+7:15604:x1876716432783616:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776717.824892:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.824921:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c5f expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776717.825067:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789776717.825209:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886120 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c5f expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.825227:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:2.0:1789776717.825231:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776717.825238:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c5f expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.825257:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0b400, rc 0) 00000100:00100000:2.0:1789776717.825365:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+8:15604:x1876716432783616:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 506us (1000us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789776717.825397:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1789776717.830276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776717.830448:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432783872 00000100:00100000:1.0:1789776717.830462:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432783872 00000100:00100000:1.0:1789776717.830768:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1789776717.830781:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+8:15604:x1876716432783872:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:1.0:1789776717.830890:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776717.830930:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886119 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c58 expref: 8 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.830955:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:1.0:1789776717.830961:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776717.830990:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.831005:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.831017:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776717.831293:0:18719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000929e410b reply state 00000000cf50fcf3 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.831308:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776717.831328:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:1.0:1789776717.831331:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789776717.831334:0:18719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789776717.831344:0:18719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789776717.831458:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+9:15604:x1876716432783872:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 679us (1198us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789776717.831467:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1789776717.836814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776717.836949:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432784128 00000100:00100000:0.0:1789776717.836965:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432784128 00000100:00100000:0.0:1789776717.837161:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1789776717.837174:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+9:15604:x1876716432784128:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776717.837755:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+10:15604:x1876716432784128:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 581us (1276us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789776717.837764:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1789776717.841693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.841778:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432784384 00000100:00100000:2.0:1789776717.841792:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432784384 00000100:00100000:2.0:1789776717.841878:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1789776717.841892:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+10:15604:x1876716432784384:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776717.841925:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.841953:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c66 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842057:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842075:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842089:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842101:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842109:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842116:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776717.842257:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789776717.842374:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842406:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842414:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842420:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.842425:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842434:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842449:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:2.0:1789776717.842453:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.842458:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842464:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88613c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842863:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842872:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842879:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842885:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776717.842900:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842909:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842919:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776717.842922:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776717.842926:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842932:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb886143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842986:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886135 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c66 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.842997:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:2.0:1789776717.842999:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776717.843003:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb886135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c66 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.843014:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0b400, rc 0) 00000100:00100000:2.0:1789776717.843104:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+11:15604:x1876716432784384:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1214us (1426us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789776717.843113:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1789776717.847541:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776717.847830:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432784512 00000100:00100000:1.0:1789776717.847942:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432784512 00000100:00100000:3.0:1789776717.848123:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:3.0:1789776717.848139:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+11:15604:x1876716432784512:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776717.848173:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776717.848206:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb886151 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c6d expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848392:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848428:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848439:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776717.848466:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776717.848469:0:17190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776717.848532:0:17190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848567:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb886151 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 13 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848590:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 12 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.848610:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:3.0:1789776717.848614:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776717.848619:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217f000, rc 0) 00000100:00100000:3.0:1789776717.848715:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+12:15604:x1876716432784512:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 580us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776717.848722:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1789776717.854092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776717.854188:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432784640 00000100:00100000:3.0:1789776717.854202:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432784640 00000100:00100000:3.0:1789776717.854282:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1789776717.854295:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+12:15604:x1876716432784640:12345-192.168.204.27@tcp:37:lfs.0 00010000:00010000:1.0:1789776717.858771:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776717.859921:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+12:15604:x1876716432784640:12345-192.168.204.27@tcp:37:lfs.0 Request processed in 5614us (5830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776717.859952:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:2.0:1789776717.865010:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776717.865173:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432784896 00000100:00100000:0.0:1789776717.865187:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432784896 00000100:00100000:0.0:1789776717.865261:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1789776717.865274:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc36af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+12:15604:x1876716432784896:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1789776717.865824:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc36af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+13:15604:x1876716432784896:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 549us (825us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789776717.865834:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1789776717.935835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776717.935934:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785024 00000100:00100000:3.0:1789776717.935946:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785024 00000100:00100000:3.0:1789776717.936028:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1789776717.936040:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+11:15610:x1876716432785024:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776717.936067:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776717.936096:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb88615f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c74 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936182:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936201:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936216:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936229:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936236:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936243:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936356:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886174 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936387:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886174 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936394:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886174 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776717.936441:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789776717.936445:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789776717.936744:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886174 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936760:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936767:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936774:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936781:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217fa00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776717.936785:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936793:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936807:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:3.0:1789776717.936810:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776717.936817:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936835:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fa00/0xf13b8042cb886166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936853:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936858:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936864:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936870:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5d0217f600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776717.936873:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936879:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936887:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:3.0:1789776717.936890:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776717.936893:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936900:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f600/0xf13b8042cb88616d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936932:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217ea00/0xf13b8042cb88615f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c74 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936961:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217fc00/0xf13b8042cb886174 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c74 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.936968:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:3.0:1789776717.936971:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776717.936973:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5d0217fc00, rc 0) 00000100:00100000:2.0:1789776717.937195:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+12:15610:x1876716432785024:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1155us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.937215:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1789776717.942304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.942619:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785152 00000100:00100000:2.0:1789776717.942632:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785152 00000100:00100000:2.0:1789776717.942747:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1789776717.942761:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:15610:x1876716432785152:12345-192.168.204.27@tcp:900:bash.0 00000100:00100000:2.0:1789776717.942881:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:15610:x1876716432785152:12345-192.168.204.27@tcp:900:bash.0 Request processed in 123us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.942889:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1789776717.945097:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776717.945186:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785408 00000100:00100000:3.0:1789776717.945198:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785408 00000100:00100000:3.0:1789776717.945270:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1789776717.945282:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+12:15610:x1876716432785408:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1789776717.945321:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776717.945349:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb88617b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c7b expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.945525:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.945543:0:18719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 12 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.945553:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.945594:0:18719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 12 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.945607:0:18719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 12 pid: 17190 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776717.945641:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0892300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632384:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776717.945737:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776717.950301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776717.950559:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785536 00000100:00100000:0.0:1789776717.950572:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785536 00010000:00010000:0.0:1789776717.950625:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 13 pid: 17190 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776717.950687:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1789776717.950699:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+13:2412:x1876716432785536:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776717.950720:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776717.950728:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 13 pid: 17190 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.950743:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 13 pid: 17190 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.950771:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:0.0:1789776717.950797:0:19528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.950809:0:19528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.950818:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776717.950846:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776717.950925:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+13:2412:x1876716432785536:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 228us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776717.950933:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00010000:00010000:3.0:1789776717.953843:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5d0217f000/0xf13b8042cb886158 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c6d expref: 12 pid: 17190 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776717.953876:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0892300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632384:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776717.953907:0:18719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.953920:0:18719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.953926:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.953963:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.953980:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.953993:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955181:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955202:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955227:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776717.955267:0:18719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789776717.955328:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955335:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955343:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955349:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d800 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776717.955353:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955362:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955375:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:3.0:1789776717.955378:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776717.955382:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955387:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb886182 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776717.955401:0:18719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56d5953 reply state 0000000013f98f8b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955423:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955430:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a5bc2122d00) 00010000:00010000:3.0:1789776717.955432:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789776717.955436:0:18719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776717.955558:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb88617b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 15 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955583:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 14 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776717.955591:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:3.0:1789776717.955593:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789776717.955596:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342d200, rc 0) 00000100:00100000:3.0:1789776717.955694:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+15:15610:x1876716432785408:12345-192.168.204.27@tcp:101:bash.0 Request processed in 10414us (10606us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789776717.955704:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1789776717.967481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.967754:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785664 00000100:00100000:2.0:1789776717.967768:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785664 00000100:00100000:2.0:1789776717.967854:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1789776717.967867:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+15:15610:x1876716432785664:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1789776717.967903:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776717.967930:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88619e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c82 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968018:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968169:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968185:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776717.968255:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789776717.968260:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776717.968289:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968396:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968429:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb88619e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968455:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776717.968466:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776717.968469:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776717.968474:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0a800, rc 0) 00000100:00100000:2.0:1789776717.968781:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:15610:x1876716432785664:12345-192.168.204.27@tcp:101:bash.0 Request processed in 913us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776717.968790:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1789776717.972381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776717.972735:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432785920 00000100:00100000:2.0:1789776717.972748:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432785920 00000100:00100000:2.0:1789776717.972851:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1789776717.972862:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:15610:x1876716432785920:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1789776717.973230:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+17:15610:x1876716432785920:12345-192.168.204.27@tcp:35:bash.0 Request processed in 367us (860us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789776717.973239:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1789776718.011646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.011694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.011743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.011774:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.011829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.011902:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786176 00000100:00100000:2.0:1789776718.011918:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786176 00000100:00100000:2.0:1789776718.011997:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786432 00000100:00100000:2.0:1789776718.012001:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786432 00000100:00100000:2.0:1789776718.012019:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786304 00000100:00100000:2.0:1789776718.012036:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786304 00000100:00100000:2.0:1789776718.012054:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786560 00000100:00100000:2.0:1789776718.012056:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786560 00000100:00100000:2.0:1789776718.012076:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1789776718.012087:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432786176:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776718.012183:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432786176:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 97us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.012192:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1789776718.012212:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776718.012218:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432786432:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776718.012254:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432786432:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.012260:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1789776718.012272:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776718.012279:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432786304:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776718.012304:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2412:x1876716432786304:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.012321:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1789776718.012334:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776718.012341:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432786560:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1789776718.012364:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2412:x1876716432786560:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.012370:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1789776718.012465:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786048 00000100:00100000:0.0:1789776718.012469:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786048 00000100:00100000:0.0:1789776718.012533:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:0.0:1789776718.012541:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2412:x1876716432786048:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1789776718.012570:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2412:x1876716432786048:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776718.012578:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00080000:0.0:1789776718.012641:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776718.012646:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776718.036889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776718.036994:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432786816 00000100:00100000:3.0:1789776718.037006:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432786816 00000100:00100000:3.0:1789776718.037096:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1789776718.037108:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+17:15620:x1876716432786816:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1789776718.037140:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776718.037167:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c89 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776718.037296:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789776718.037459:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c89 expref: 19 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.037985:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a5cd91eb500) 00010000:00010000:3.0:1789776718.037990:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776718.037998:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c89 expref: 19 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.038014:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ce00, rc 0) 00000100:00100000:3.0:1789776718.038148:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+18:15620:x1876716432786816:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1041us (1274us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789776718.038157:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1789776718.046087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776718.046175:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432787072 00000100:00100000:3.0:1789776718.046188:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432787072 00000100:00100000:3.0:1789776718.046257:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1789776718.046269:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+18:15620:x1876716432787072:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1789776718.046779:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+19:15620:x1876716432787072:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 511us (704us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789776718.046788:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1789776718.090375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.092665:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432787328 00000100:00100000:2.0:1789776718.092711:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432787328 00000100:00100000:2.0:1789776718.092805:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1789776718.092819:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+19:15623:x1876716432787328:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1789776718.092853:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776718.092883:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb8861ba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c90 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.093056:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb8861c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.093077:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb8861c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.093093:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb8861c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776718.093109:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789776718.093252:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb8861ba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c90 expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.093284:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb8861c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c90 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.093294:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776718.093297:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776718.093302:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0a200, rc 0) 00000100:00100000:2.0:1789776718.093420:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:15623:x1876716432787328:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 603us (3060us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789776718.093429:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1789776718.100912:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.101052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776718.101071:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432787584 00000100:00100000:3.0:1789776718.101084:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432787584 00000100:00100000:0.0:1789776718.101183:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432787456 00000100:00100000:0.0:1789776718.101188:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432787456 00000100:00100000:3.0:1789776718.101242:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1789776718.101256:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:15623:x1876716432787584:12345-192.168.204.27@tcp:54:lfs.0 00000100:00100000:0.0:1789776718.101277:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1789776718.101286:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:2412:x1876716432787456:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776718.101319:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776718.101864:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.102182:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb8861c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c90 expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.102221:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.102242:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.102893:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776718.102903:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776718.102968:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.102979:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776718.102990:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:2412:x1876716432787456:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1703us (1940us total) trans 0 rc 0/0 00010000:00010000:3.0:1789776718.102998:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776718.103001:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:3.0:1789776718.103006:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342ce00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:3.0:1789776718.103011:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.103020:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.103031:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:3.0:1789776718.103034:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776718.103038:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.103044:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776718.103092:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+20:15623:x1876716432787584:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 1840us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776718.103101:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1789776718.108012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.108686:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432787840 00000100:00100000:2.0:1789776718.108702:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432787840 00000100:00100000:2.0:1789776718.108789:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1789776718.108801:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+20:15623:x1876716432787840:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1789776718.109182:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:15623:x1876716432787840:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 382us (1184us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789776718.109192:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000040:00080000:2.0:1789776718.311044:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789776718.371802:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789776718.405668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.405776:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788096 00000100:00100000:2.0:1789776718.405790:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788096 00000100:00100000:2.0:1789776718.405875:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:2.0:1789776718.405889:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:15654:x1876716432788096:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1789776718.406315:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776718.406345:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb8861d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c97 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.406544:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8861dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.406564:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8861dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.406579:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8861dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776718.406592:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789776718.406771:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb8861d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c97 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.406820:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8861dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c97 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.406830:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776718.406833:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776718.406838:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0b400, rc 0) 00000100:00100000:2.0:1789776718.407426:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:15654:x1876716432788096:12345-192.168.204.27@tcp:101:cat.0 Request processed in 1537us (1768us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789776718.407438:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1789776718.416523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.416629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776718.416720:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788224 00000100:00100000:0.0:1789776718.416733:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788224 00000100:00100000:0.0:1789776718.416813:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1789776718.416827:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:2414:x1876716432788224:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776718.416849:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776718.416882:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb8861dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c97 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.416916:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776718.416922:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776718.416995:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:2414:x1876716432788224:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 170us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776718.417003:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1789776718.417022:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788480 00000100:00100000:2.0:1789776718.417027:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788480 00000100:00100000:2.0:1789776718.417083:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1789776718.417091:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:15654:x1876716432788480:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:2.0:1789776718.417466:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:15654:x1876716432788480:12345-192.168.204.27@tcp:35:cat.0 Request processed in 375us (835us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789776718.417474:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1789776718.492717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.492909:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788736 00000100:00100000:2.0:1789776718.492922:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788736 00000100:00100000:3.0:1789776718.493430:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1789776718.493459:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:15660:x1876716432788736:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1789776718.493791:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776718.493818:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb8861eb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5c9e expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.493983:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494001:0:18719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494011:0:18719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494020:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494065:0:18719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494095:0:18719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 24 pid: 17192 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776718.494110:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0893100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632512:192.168.204.27@tcp:104: 00010000:00010000:3.0:1789776718.494567:0:18719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776718.494611:0:18719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776718.494627:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf0892680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632640:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776718.494668:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776718.502959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.503244:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0893100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632512:192.168.204.27@tcp:104: 00000100:00100000:1.0:1789776718.503261:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf0892680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449632640:192.168.204.27@tcp:104: 00010000:00010000:1.0:1789776718.503294:0:18719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776718.503998:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788864 00000100:00100000:2.0:1789776718.504009:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788864 00010000:00010000:2.0:1789776718.504144:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 25 pid: 17192 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776718.504284:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1789776718.504312:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+25:2411:x1876716432788864:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776718.504358:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776718.504368:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 25 pid: 17192 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.504385:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 25 pid: 17192 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.504412:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb8861a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c82 expref: 25 pid: 17192 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.504434:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776718.504439:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.504449:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.504457:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776718.504614:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+24:2411:x1876716432788864:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 319us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.504624:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1789776718.505111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776718.506369:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432788992 00000100:00100000:0.0:1789776718.506386:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432788992 00010000:00010000:0.0:1789776718.506439:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776718.506923:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1789776718.506936:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+24:2411:x1876716432788992:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776718.506974:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776718.506983:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.506999:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.507024:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d200/0xf13b8042cb886190 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c7b expref: 24 pid: 18719 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.507055:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776718.507061:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.507072:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.507080:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.507116:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776718.507376:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:2411:x1876716432788992:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 442us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776718.507385:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00010000:00010000:1.0:1789776718.507655:0:18719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776718.507665:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776718.507689:0:18719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789776718.507925:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342d800/0xf13b8042cb8861eb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c9e expref: 24 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776718.507944:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342ce00/0xf13b8042cb8861f2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5c9e expref: 23 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776718.507951:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:1.0:1789776718.507954:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776718.507957:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342ce00, rc 0) 00000100:00100000:1.0:1789776718.507993:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:15660:x1876716432788736:12345-192.168.204.27@tcp:101:dd.0 Request processed in 14553us (15292us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789776718.508000:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1789776718.513281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776718.513957:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432789120 00000100:00100000:0.0:1789776718.513971:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432789120 00000100:00100000:2.0:1789776718.514156:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1789776718.514173:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+23:15660:x1876716432789120:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1789776718.514220:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776718.514249:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb886200 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ca5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.514332:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.515849:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.515869:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.516164:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb886200 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 25 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.516188:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.516198:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776718.516201:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776718.516205:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0b000, rc 0) 00000100:00100000:2.0:1789776718.516412:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+24:15660:x1876716432789120:12345-192.168.204.27@tcp:101:dd.0 Request processed in 2241us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.516422:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:1.0:1789776718.521850:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.521953:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432789376 00000100:00100000:2.0:1789776718.521966:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432789376 00000100:00100000:2.0:1789776718.522050:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1789776718.522064:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+24:15660:x1876716432789376:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:2.0:1789776718.522398:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.522443:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.522459:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776718.522551:0:17190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789776718.522579:0:17190:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a187d52 reply state 0000000049140755 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.522593:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.522601:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776718.522604:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789776718.522609:0:17190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776718.522856:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432789376:12345-192.168.204.27@tcp:36:dd.0 Request processed in 792us (1018us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789776718.522865:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000020:00080000:2.0:1789776718.522871:0:17190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789776718.530142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776718.530246:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432789504 00000100:00100000:0.0:1789776718.530260:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432789504 00000100:00100000:0.0:1789776718.530350:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1789776718.530382:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432789504:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1789776718.530416:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776718.530444:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb886215 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cac expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.531324:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb886215 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cac expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.531345:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb886215 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cac expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.531370:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776718.531373:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776718.531377:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdf200, rc 0) 00000100:00100000:0.0:1789776718.531609:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15660:x1876716432789504:12345-192.168.204.27@tcp:101:dd.0 Request processed in 1229us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776718.531618:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1789776718.550830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776718.551205:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432789760 00000100:00100000:1.0:1789776718.551217:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432789760 00000100:00100000:1.0:1789776718.551317:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1789776718.551330:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15660:x1876716432789760:12345-192.168.204.27@tcp:103:dd.0 00010000:00010000:1.0:1789776718.551351:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776718.551385:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdf200/0xf13b8042cb886215 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cac expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776718.551432:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:1.0:1789776718.551438:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776718.551579:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432789760:12345-192.168.204.27@tcp:103:dd.0 Request processed in 251us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776718.551587:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1789776718.554736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776718.554892:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432789888 00000100:00100000:2.0:1789776718.554906:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432789888 00000100:00100000:2.0:1789776718.554984:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:2.0:1789776718.554998:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432789888:12345-192.168.204.27@tcp:58:dd.0 00010000:00010000:2.0:1789776718.555154:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.555178:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776718.555216:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776718.559079:0:18719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776718.560116:0:18719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789776718.560361:0:18719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789776718.560581:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432789888:12345-192.168.204.27@tcp:58:dd.0 Request processed in 5577us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776718.560597:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:2.0:1789776718.566948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776718.567073:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790016 00000100:00100000:0.0:1789776718.567086:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790016 00000100:00100000:0.0:1789776718.567166:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1789776718.567179:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+27:15660:x1876716432790016:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1789776718.567209:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776718.567236:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cb3 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567319:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567355:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567379:0:17191:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567396:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567412:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776718.567416:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776718.567420:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776718.567431:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc3cdfc00, rc 0) 00000100:00100000:0.0:1789776718.567893:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15660:x1876716432790016:12345-192.168.204.27@tcp:101:dd.0 Request processed in 713us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776718.567903:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00010000:00010000:1.0:1789776718.883777:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776719.331713:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776719.331728:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776719.331772:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789776719.331785:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789776719.331995:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17225:1876716449632768:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776719.332599:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789776719.341095:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17225:1876716449632768:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776719.345235:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776719.345487:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790144 00000100:00100000:3.0:1789776719.345525:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790144 00000100:00100000:3.0:1789776719.345735:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1789776719.345748:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15662:x1876716432790144:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1789776719.345771:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1789776719.345783:0:17190:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789776719.345969:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15662:x1876716432790144:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 224us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776719.345977:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1789776719.355447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776719.355828:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790272 00000100:00100000:0.0:1789776719.355839:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790272 00000100:00100000:0.0:1789776719.355907:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:0.0:1789776719.355918:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15662:x1876716432790272:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789776719.356000:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356018:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356044:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356083:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356091:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356098:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356121:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356131:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356137:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776719.356189:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789776719.356194:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789776719.356893:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356914:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356920:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356941:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356947:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776719.356952:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356960:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356974:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5bc2121900) 00010000:00010000:0.0:1789776719.356977:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776719.356982:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.356989:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde200/0xf13b8042cb88622a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357006:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357012:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357018:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357023:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776719.357026:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357042:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357050:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a5cf512d000) 00010000:00010000:0.0:1789776719.357052:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776719.357055:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357061:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde600/0xf13b8042cb886231 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357075:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357081:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357087:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357092:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc3cde000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:0.0:1789776719.357095:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357101:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357107:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:0.0:1789776719.357110:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776719.357112:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.357127:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb886238 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776719.359170:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15662:x1876716432790272:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 1294us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776719.359187:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1789776719.365806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.368855:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790528 00000100:00100000:2.0:1789776719.368872:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790528 00000100:00100000:2.0:1789776719.368957:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1789776719.368968:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+28:15662:x1876716432790528:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.368990:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776719.369013:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb88623f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cba expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369124:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369160:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369172:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776719.369186:0:18719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789776719.369269:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369277:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369296:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369302:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.369306:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369313:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369325:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776719.369329:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789776719.369333:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369339:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886246 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369383:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb88623f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cba expref: 30 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369401:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a5bc2121900) 00010000:00010000:2.0:1789776719.369404:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776719.369408:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a800/0xf13b8042cb88623f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cba expref: 30 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.369418:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc4b0a800, rc 0) 00000100:00100000:2.0:1789776719.369641:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+29:15662:x1876716432790528:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 674us (4020us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789776719.369650:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1789776719.381393:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.381550:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790656 00000100:00100000:2.0:1789776719.381561:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790656 00000100:00100000:2.0:1789776719.381618:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1789776719.381628:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+29:15662:x1876716432790656:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776719.381682:0:17191:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776719.381832:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+29:15662:x1876716432790656:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 204us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.381840:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1789776719.389300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.390106:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432790912 00000100:00100000:2.0:1789776719.390121:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432790912 00000100:00100000:2.0:1789776719.390235:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1789776719.390249:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+29:15662:x1876716432790912:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.390272:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776719.390312:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886254 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cc1 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776719.391087:0:18719:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1789776719.391095:0:18719:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789776719.391182:0:18719:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789776719.391898:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb88625b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.391918:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb88625b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.391929:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb88625b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.391990:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886254 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cc1 expref: 32 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.392011:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb88625b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cc1 expref: 31 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.392020:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2121400) 00010000:00010000:2.0:1789776719.392023:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776719.392026:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc257600, rc 0) 00000100:00100000:2.0:1789776719.392162:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+31:15662:x1876716432790912:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1916us (2879us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789776719.392171:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1789776719.399395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.399534:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432791168 00000100:00100000:2.0:1789776719.399544:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432791168 00000100:00100000:2.0:1789776719.399594:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1789776719.399602:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+31:15662:x1876716432791168:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.399678:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776719.399705:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb88625b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cc1 expref: 31 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399726:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2121400) 00010000:00010000:2.0:1789776719.399735:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776719.399766:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399780:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399790:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399855:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399864:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399871:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399923:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399930:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399936:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399949:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256e00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.399953:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399961:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399970:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:2.0:1789776719.399973:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.399977:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399983:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb886269 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.399994:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400000:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400007:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400011:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.400014:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400019:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400056:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2e340013 (ffff8a5bc2121200) 00010000:00010000:2.0:1789776719.400058:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.400061:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.400067:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886270 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e340013 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.400160:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+30:15662:x1876716432791168:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 556us (774us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776719.400168:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1789776719.408354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776719.408942:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432791296 00000100:00100000:3.0:1789776719.408953:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432791296 00000100:00100000:3.0:1789776719.409021:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1789776719.409044:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+30:15662:x1876716432791296:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776719.409067:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776719.409092:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342de00/0xf13b8042cb886277 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cc8 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409159:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342dc00/0xf13b8042cb88627e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409175:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342dc00/0xf13b8042cb88627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409188:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342dc00/0xf13b8042cb88627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409317:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342de00/0xf13b8042cb886277 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cc8 expref: 32 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409336:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342dc00/0xf13b8042cb88627e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cc8 expref: 31 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.409345:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:3.0:1789776719.409348:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789776719.409352:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5bc342dc00, rc 0) 00000100:00100000:3.0:1789776719.409427:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+31:15662:x1876716432791296:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 386us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776719.409435:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1789776719.419656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.419881:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432791552 00000100:00100000:2.0:1789776719.419893:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432791552 00000100:00100000:2.0:1789776719.419951:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1789776719.419963:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+31:15662:x1876716432791552:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.420071:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.420091:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.420103:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776719.420295:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789776719.420306:0:17191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 540664812359ns, next at 541664810020ns, rc = 0 00000004:00010000:2.0:1789776719.420356:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5648ed7 reply state 0000000091aed289 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.420388:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.420395:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:2.0:1789776719.420398:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789776719.420402:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776719.420899:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+33:15662:x1876716432791552:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 922us (1236us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789776719.420909:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1789776719.427476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.427756:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432791680 00000100:00100000:2.0:1789776719.427767:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432791680 00000100:00100000:2.0:1789776719.427838:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:2.0:1789776719.427849:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+33:15662:x1876716432791680:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.427875:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776719.427897:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ccf expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.428159:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 34 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.428176:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 34 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.428199:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:2.0:1789776719.428203:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776719.428207:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256e00, rc 0) 00000100:00100000:2.0:1789776719.428272:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+34:15662:x1876716432791680:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 425us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.428304:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1789776719.433055:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.433715:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432791808 00000100:00100000:2.0:1789776719.433728:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432791808 00000100:00100000:2.0:1789776719.433799:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1789776719.433812:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432791808:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789776719.434093:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2411:x1876716432791808:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 283us (1061us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789776719.434101:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1789776719.439392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.439548:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792064 00000100:00100000:2.0:1789776719.439609:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792064 00000100:00100000:2.0:1789776719.439998:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1789776719.440011:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+34:15662:x1876716432792064:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776719.440242:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+35:15662:x1876716432792064:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 233us (860us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789776719.440251:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1789776719.446371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.447079:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792320 00000100:00100000:2.0:1789776719.447091:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792320 00000100:00100000:2.0:1789776719.447160:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1789776719.447172:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+35:15662:x1876716432792320:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776719.447308:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+35:15662:x1876716432792320:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 137us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.447316:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1789776719.450978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.451084:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792448 00000100:00100000:2.0:1789776719.451094:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792448 00000100:00100000:2.0:1789776719.451175:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1789776719.451185:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+35:15662:x1876716432792448:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.451206:0:18719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776719.451227:0:18719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb886293 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cd6 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451321:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451335:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451347:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776719.451392:0:18719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789776719.451411:0:18719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451435:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb886293 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cd6 expref: 37 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451461:0:18719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cd6 expref: 36 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.451470:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:2.0:1789776719.451472:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789776719.451476:0:18719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256c00, rc 0) 00000100:00100000:2.0:1789776719.452024:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+36:15662:x1876716432792448:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 839us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.452043:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1789776719.455900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776719.456082:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792576 00000100:00100000:1.0:1789776719.456091:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792576 00000100:00100000:1.0:1789776719.456150:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1789776719.456160:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+6:2412:x1876716432792576:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776719.456178:0:18698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776719.456198:0:18698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5cdd expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776719.456243:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd350, blocks: 0x0 00010000:00010000:1.0:1789776719.456264:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1789776719.456268:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776719.456294:0:18698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 7 pid: 18698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.456315:0:18698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 7 pid: 18698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.456328:0:18698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cc79c1a00, rc 0) 00000100:00100000:1.0:1789776719.456391:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2412:x1876716432792576:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 232us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776719.456398:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1789776719.461174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.461441:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792832 00000100:00100000:2.0:1789776719.461531:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792832 00000100:00100000:2.0:1789776719.461643:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1789776719.461655:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+36:15662:x1876716432792832:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776719.461788:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+36:15662:x1876716432792832:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 136us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.461794:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1789776719.466177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.466259:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432792960 00000100:00100000:2.0:1789776719.466270:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432792960 00000100:00100000:2.0:1789776719.466345:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1789776719.466355:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+36:15662:x1876716432792960:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789776719.469187:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789776719.469203:0:17170:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789776719.469332:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469345:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469353:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469359:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.469364:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469372:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469404:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a5bc2121e00) 00010000:00010000:2.0:1789776719.469407:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.469412:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469418:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a600/0xf13b8042cb8860da lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469439:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469454:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469460:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469464:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.469466:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469472:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469480:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:2.0:1789776719.469482:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.469485:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469525:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a000/0xf13b8042cb8860e1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469551:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469557:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469562:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469567:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342cc00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.469570:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469576:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469584:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a5bc2122d00) 00010000:00010000:2.0:1789776719.469586:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.469589:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469594:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc342cc00/0xf13b8042cb886189 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469608:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469615:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469621:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469641:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0b400 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.469645:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469651:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469660:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776719.469662:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.469666:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469680:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b400/0xf13b8042cb88620e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469693:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469699:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469704:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469709:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.469711:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.469717:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.470074:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:2.0:1789776719.470078:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789776719.470082:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.470089:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb886285 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776719.470385:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00080000:3.0:1789776719.470934:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789776719.471139:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471150:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471156:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471163:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.471167:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471174:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471187:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a5bc2121500) 00010000:00010000:2.0:1789776719.471189:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789776719.471193:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.471199:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb88612e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.471432:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+15:15662:x1876716432792960:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 5073us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.471442:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1789776719.473425:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449632896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789776719.473532:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776719.474640:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449632896 00000100:00100000:2.0:1789776719.474651:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449632896 00000100:00100000:2.0:1789776719.474961:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776719.474974:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449632896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789776719.475110:0:18697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789776719.475115:0:18697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789776719.475117:0:18697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789776719.475119:0:18697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789776720 -> 1789776720 00002000:00010000:2.0:1789776719.475122:0:18697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789776719.475240:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876716449632896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 269us (1707us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789776719.475248:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789776719.475364:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776719.475654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.475938:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793088 00000100:00100000:2.0:1789776719.475945:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793088 00000100:00100000:2.0:1789776719.475982:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1789776719.475989:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2412:x1876716432793088:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789776719.476075:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2412:x1876716432793088:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 85us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.476082:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000004:00080000:0.0:1789776719.477647:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a5cff464e00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1789776719.477659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449632896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776719.479937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776719.480260:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793344 00000100:00100000:0.0:1789776719.480270:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793344 00000100:00100000:0.0:1789776719.480336:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1789776719.480347:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+15:15662:x1876716432793344:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789776719.480395:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776719.480421:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256c00/0xf13b8042cb88629a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cd6 expref: 15 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.480438:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:0.0:1789776719.480443:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776719.480666:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb8862a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.480679:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb8862a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.480688:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb8862a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776719.481013:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006add4136 reply state 00000000b2e166ff transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb8862a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.481086:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cde000/0xf13b8042cb8862a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.481094:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:0.0:1789776719.481097:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789776719.481100:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776719.481231:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf5e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:15662:x1876716432793344:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 884us (1299us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789776719.481238:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1789776719.486968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776719.487243:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793472 00000100:00100000:1.0:1789776719.487252:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793472 00000100:00100000:1.0:1789776719.487330:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1789776719.487342:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2411:x1876716432793472:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789776719.487539:0:20136:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789776719.487543:0:20136:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789776719 00002000:00010000:1.0:1789776719.487545:0:20136:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789776719 00002000:00010000:1.0:1789776719.487561:0:20136:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789776720 -> 1789776719 00002000:00010000:1.0:1789776719.487563:0:20136:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789776719.487632:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46b2d271-3290-4278-a9ba-b0b58b3db4ff+8:2411:x1876716432793472:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 286us (668us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789776719.487640:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1789776719.491119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.491209:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793600 00000100:00100000:2.0:1789776719.491218:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793600 00000100:00100000:2.0:1789776719.491308:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1789776719.491318:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+8:2412:x1876716432793600:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.491363:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491380:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776719.491384:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776719.491390:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491404:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491429:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491437:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491457:0:19184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491465:0:19184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:2.0:1789776719.491469:0:19184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491478:0:19184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491533:0:19184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.491543:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b4ac897/0xf13b8042cb8862af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.491612:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+8:2412:x1876716432793600:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 295us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.491620:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1789776719.494811:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.494950:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793856 00000100:00100000:2.0:1789776719.494961:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793856 00000100:00100000:2.0:1789776719.495029:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1789776719.495040:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:15662:x1876716432793856:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789776719.495124:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.495143:0:18719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.495153:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.495191:0:18719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.495206:0:18719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 16 pid: 17191 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.495237:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633024:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776719.495337:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776719.499793:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.499953:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633024:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776719.499983:0:18719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776719.500056:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432793984 00000100:00100000:3.0:1789776719.500064:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432793984 00010000:00010000:3.0:1789776719.500100:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 17 pid: 17191 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776719.500133:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1789776719.500141:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+17:2411:x1876716432793984:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776719.500157:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776719.500164:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 17 pid: 17191 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500177:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 17 pid: 17191 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500198:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0b000/0xf13b8042cb886207 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ca5 expref: 17 pid: 17191 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500220:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:3.0:1789776719.500227:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500236:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500242:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500250:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.500470:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776719.500554:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:2411:x1876716432793984:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 412us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776719.500563:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00010000:00010000:2.0:1789776719.502265:0:18719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502291:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502554:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502572:0:18719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 16 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502582:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502623:0:18719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 16 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.502639:0:18719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 16 pid: 18719 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.502653:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633152:192.168.204.27@tcp:104: 00000100:00100000:2.0:1789776719.503041:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776719.506549:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633152:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776719.506580:0:18719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776719.508677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776719.508875:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794112 00000100:00100000:3.0:1789776719.508885:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794112 00010000:00010000:3.0:1789776719.508924:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 17 pid: 18719 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776719.508970:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1789776719.508981:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+17:2411:x1876716432794112:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776719.508994:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776719.509001:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 17 pid: 18719 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509015:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 17 pid: 18719 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509050:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb88628c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ccf expref: 17 pid: 18719 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509067:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:3.0:1789776719.509072:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509081:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509106:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.509140:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776719.509199:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+16:2411:x1876716432794112:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 220us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776719.509207:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00010000:00010000:2.0:1789776719.510071:0:18719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.510081:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776719.510194:0:18719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789776719.510452:0:18719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789776719.510600:0:18719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789776719.510702:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18719:1876716449633280:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789776719.511226:0:18719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776719.511260:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc651a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776719.512639:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449633280 00000100:00100000:3.0:1789776719.512651:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449633280 00000100:00100000:3.0:1789776719.512725:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776719.512746:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18719:x1876716449633280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789776719.512874:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18719:x1876716449633280:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776719.512882:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776719.513471:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18719:1876716449633280:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789776719.513715:0:18719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789776719.513805:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff464380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18719:1876716449633408:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789776719.513849:0:18719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776719.513868:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776719.514014:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449633408 00000100:00100000:0.0:1789776719.514020:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449633408 00000100:00100000:0.0:1789776719.514179:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776719.514195:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18719:x1876716449633408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789776719.514335:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18719:x1876716449633408:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (485us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789776719.514343:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789776719.514476:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff464380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18719:1876716449633408:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789776719.514548:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514558:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514565:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514571:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257c00 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776719.514575:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514719:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514862:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:1.0:1789776719.514866:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776719.514871:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514878:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257c00/0xf13b8042cb8862bd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514912:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514918:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514925:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514930:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc4b0a200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:1.0:1789776719.514933:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514940:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514948:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:1.0:1789776719.514950:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776719.514957:0:18719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514982:0:18719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.514992:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.515902:0:18719:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a5bc3cdfc00/0xf13b8042cb886223 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cb3 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776719.515921:0:18719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff467480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633536:192.168.204.27@tcp:105: 00000100:00100000:1.0:1789776719.516390:0:18719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cc65b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776719.522254:0:18719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff467480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18719:1876716449633536:192.168.204.27@tcp:105: 00010000:00010000:2.0:1789776719.522362:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522373:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc4b0a200/0xf13b8042cb88621c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522410:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522424:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522435:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522590:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522597:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522603:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522609:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc256200 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.522614:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522623:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522635:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776719.522638:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776719.522641:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522647:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256200/0xf13b8042cb8862c4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522657:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522663:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522843:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522855:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cfc257600 already unused, calling callback (ffffffffc180b4f0) 00010000:00010000:2.0:1789776719.522858:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522865:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522873:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776719.522875:0:18719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776719.522878:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.522883:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc257600/0xf13b8042cb8862b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.523106:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+19:15662:x1876716432793856:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 28065us (28307us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789776719.523116:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000020:00080000:2.0:1789776719.523122:0:18719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789776719.528777:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776719.528811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1789776719.528842:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794240 00000100:00100000:1.0:1789776719.528852:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794240 00000100:00100000:1.0:1789776719.528898:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794496 00000100:00100000:1.0:1789776719.528901:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794496 00000100:00100000:1.0:1789776719.528918:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1789776719.528927:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc36ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+20:15660:x1876716432794240:12345-192.168.204.27@tcp:49:dd.0 00000100:00100000:1.0:1789776719.529066:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc36ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+20:15660:x1876716432794240:12345-192.168.204.27@tcp:49:dd.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776719.529073:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1789776719.529119:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1789776719.529127:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+19:15662:x1876716432794496:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789776719.529393:0:17193:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789776719.529444:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789776719.529482:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529527:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529539:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529549:0:17193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529555:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529562:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529580:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789776719.529632:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:15662:x1876716432794496:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 505us (819us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789776719.529640:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000020:00080000:1.0:1789776719.529643:0:17193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789776719.529662:0:18724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776719.529668:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529675:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5cc79c0000 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776719.529679:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529695:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529707:0:18724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a5bc2122f00) 00010000:00010000:1.0:1789776719.529710:0:18724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789776719.529716:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529722:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cc79c0000/0xf13b8042cb8862cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776719.529734:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776719.529736:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776719.529738:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776719.530219:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776719.530225:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776719.530244:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789776719.530252:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789776719.536070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1789776719.536147:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794624 00000100:00100000:2.0:1789776719.536159:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794624 00000100:00100000:2.0:1789776719.536228:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1789776719.536240:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+21:15660:x1876716432794624:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1789776719.536261:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776719.536315:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb8862d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87906a8077ab5ce4 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536353:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb8862d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536368:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb8862d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536380:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb8862d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536524:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256a00/0xf13b8042cb8862d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ce4 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536547:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a5cfc256e00/0xf13b8042cb8862d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5ce4 expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.536556:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a5bc2122300) 00010000:00010000:2.0:1789776719.536559:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776719.536563:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a5cfc256e00, rc 0) 00000100:00100000:2.0:1789776719.536637:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:15660:x1876716432794624:12345-192.168.204.27@tcp:101:dd.0 Request processed in 399us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776719.536644:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1789776719.784934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776719.785145:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794752 00000100:00100000:3.0:1789776719.785157:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794752 00000100:00100000:3.0:1789776719.785225:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1789776719.785235:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf0892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+8:2413:x1876716432794752:12345-192.168.204.27@tcp:4:dd.0 00010000:00010000:3.0:1789776719.785283:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.785305:0:18701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 8 pid: 18698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.785312:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789776719.785317:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776719.785335:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.785376:0:18701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 8 pid: 18698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.785390:0:18701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 8 pid: 18698 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776719.785404:0:18701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18701:1876716449633664:192.168.204.27@tcp:104: 00000100:00100000:3.0:1789776719.785512:0:18701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a5cf5c2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776719.792177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776719.793221:0:18703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789776719.793234:0:18703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789776719.793764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1789776719.793917:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795008 00000100:00100000:0.0:1789776719.793928:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795008 00010000:00010000:0.0:1789776719.793973:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 9 pid: 18698 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776719.794018:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1789776719.794029:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:2412:x1876716432795008:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776719.794061:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776719.794084:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 9 pid: 18698 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.794097:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 9 pid: 18698 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.794175:0:17175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776719.794181:0:17175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776719.794187:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.794196:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776719.794219:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776719.794286:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+9:2412:x1876716432795008:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 246us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776719.794294:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:2.0:1789776719.794852:0:18701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9812d73/0xf13b8042cb8862a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87906a8077ab5cdd expref: 8 pid: 18698 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.794871:0:18701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18701:1876716449633664:192.168.204.27@tcp:104: 00010000:00010000:2.0:1789776719.794893:0:18701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.794914:0:18701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776719.794921:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776719.808766:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432794880 00000100:00100000:0.0:1789776719.808782:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432794880 00000100:00100000:3.0:1789776719.810181:0:20332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1789776719.810199:0:20332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cf089e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+8:2414:x1876716432794880:12345-192.168.204.27@tcp:4:dd.0 00010000:00010000:3.0:1789776719.810238:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.810257:0:20332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776719.810262:0:20332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776719.810268:0:20332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.810292:0:20332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776719.906732:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776719.906789:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449633792:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789776719.906897:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776719.906907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776719.906939:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449633792 00000100:00100000:1.0:1789776719.906951:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449633792 00000100:00080000:0.0:1789776719.907090:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776719.907133:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789776719.907145:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449633792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789776719.907173:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789776719.908850:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf5e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876716449633792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789776719.910001:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876716449633792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2853us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776719.910921:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000001:00080000:2.0:1789776719.959575:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789776719.959595:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1789776719.961604:0:18701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1789776719.961612:0:18701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789776719 -> 1789776720 00002000:00010000:3.0:1789776719.962095:0:18701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789776719 -> 1789776720 00002000:00010000:3.0:1789776719.962099:0:18701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1789776719.962134:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962148:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962158:0:18701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962166:0:18701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342de00 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:3.0:1789776719.962171:0:18701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962182:0:18701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962208:0:18701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776719.962217:0:18701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608f6683/0xf13b8042cb8862e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776719.963771:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf0892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46b2d271-3290-4278-a9ba-b0b58b3db4ff+7:2413:x1876716432794752:12345-192.168.204.27@tcp:4:dd.0 Request processed in 178521us (178831us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789776719.963793:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000001:00080000:0.0:1789776720.003412:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1789776720.004348:0:20332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1789776720.004355:0:20332:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1789776720.004385:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004399:0:20332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004408:0:20332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004416:0:20332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a5bc342d600 already unused, calling callback (ffffffffc0bf0420) 00010000:00010000:1.0:1789776720.004421:0:20332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004430:0:20332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004452:0:20332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776720.004460:0:20332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007203d43a/0xf13b8042cb8862e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776720.007352:0:20332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cf089e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2414:x1876716432794880:12345-192.168.204.27@tcp:4:dd.0 Request processed in 197145us (215175us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789776720.007376:0:20332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1789776720.418756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449633920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789776720.418856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776720.418977:0:18202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449633920 00000100:00100000:3.0:1789776720.418985:0:18202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449633920 00000100:00100000:3.0:1789776720.419048:0:18202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789776720.419058:0:18202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449633920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789776720.419094:0:18202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789776720.419154:0:18202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449633920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776720.419161:0:18202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776720.419313:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449633920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789776720.419439:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449634048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789776720.419472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776720.419560:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634048 00000100:00100000:0.0:1789776720.419566:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634048 00000100:00100000:0.0:1789776720.419609:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776720.419617:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449634048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789776720.419648:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789776720.419691:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449634048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776720.419700:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789776720.419714:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449634048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789776720.931634:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776720.931656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449634176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776720.932030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776720.933364:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776720.936512:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634176 00000100:00100000:3.0:1789776720.936535:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634176 00000100:00100000:1.0:1789776720.937758:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776720.937771:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449634176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776720.937798:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1789776720.937889:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449634176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776720.937897:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776720.937964:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789776720.937970:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a5cff464e00, transno 8589934596 00000004:00080000:3.0:1789776720.937983:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789776720.938011:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449634176:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789776721.422138:0:20369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789776721.955850:0:18724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776721.956374:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449634432:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449634304:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956628:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449634816:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956713:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449635328:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956749:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449635840:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956807:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789776721.956813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449634688:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449635200:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449635712:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956912:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449634560:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956943:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449635072:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956971:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449635584:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.956987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.956997:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776721.957002:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449635968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776721.957021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776721.957050:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634304 00000100:00100000:3.0:1789776721.957058:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634304 00000100:00100000:3.0:1789776721.957326:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789776721.957336:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:3644:x1876716449634304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.957389:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:086c90d1-9383-41b8-afea-b47b6abf291d+24:3644:x1876716449634304:12345-0@lo:400:kworker.0 Request processed in 55us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776721.957408:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789776721.957441:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634816 00000100:00100000:3.0:1789776721.957444:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634816 00000100:00100000:3.0:1789776721.957463:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635328 00000100:00100000:3.0:1789776721.957472:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635328 00000100:00100000:3.0:1789776721.957485:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635840 00000100:00100000:3.0:1789776721.957488:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635840 00000100:00100000:3.0:1789776721.957868:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635712 00000100:00100000:3.0:1789776721.957872:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635712 00000100:00100000:3.0:1789776721.957887:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635584 00000100:00100000:3.0:1789776721.957889:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635584 00000100:00100000:3.0:1789776721.957906:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789776721.957912:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449634816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.957953:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876716449634816:12345-0@lo:400:kworker.0 Request processed in 41us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776721.957959:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789776721.957974:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776721.957979:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.958005:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876716449635328:12345-0@lo:400:kworker.0 Request processed in 27us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776721.958011:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776721.958021:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789776721.958026:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449635840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.958052:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876716449635840:12345-0@lo:400:kworker.0 Request processed in 26us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776721.958058:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789776721.958204:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634688 00000100:00100000:1.0:1789776721.958208:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634688 00000100:00100000:1.0:1789776721.958252:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635200 00000100:00100000:1.0:1789776721.958256:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635200 00000100:00100000:1.0:1789776721.958269:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634560 00000100:00100000:1.0:1789776721.958271:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634560 00000100:00100000:1.0:1789776721.958282:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635072 00000100:00100000:1.0:1789776721.958284:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635072 00000100:00100000:1.0:1789776721.958295:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776721.958301:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cff464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449634688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.958336:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cff464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876716449634688:12345-0@lo:400:kworker.0 Request processed in 35us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776721.958341:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776721.958353:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776721.958359:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449635200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.958385:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876716449635200:12345-0@lo:400:kworker.0 Request processed in 27us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776721.958412:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776721.958426:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776721.958432:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449634560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.958469:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449634560:12345-0@lo:400:kworker.0 Request processed in 38us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776721.958474:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776721.958484:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776721.958830:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449635072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.958871:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449635072:12345-0@lo:400:kworker.0 Request processed in 381us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776721.958878:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789776721.958976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776721.959008:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449634944:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776721.959052:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cf089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449635456:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776721.959124:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776721.959129:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776721.959132:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776721.959134:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789776721.959144:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634432 00000100:00100000:0.0:1789776721.959149:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634432 00000100:00100000:0.0:1789776721.959178:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449634944 00000100:00100000:0.0:1789776721.959181:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449634944 00000100:00100000:0.0:1789776721.959195:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776721.959201:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449634432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959251:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876716449634432:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776721.959257:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776721.959269:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776721.959275:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449634944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959312:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876716449634944:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776721.959319:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776721.959359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876716449634432:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959370:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876716449634944:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959439:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449634560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959450:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449635072:0@lo:400:kworker.0 00000100:00100000:0.0:1789776721.959480:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635968 00000100:00100000:0.0:1789776721.959484:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635968 00000100:00100000:0.0:1789776721.959540:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776721.959547:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449635968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776721.959567:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776721.959610:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876716449635968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776721.959615:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776721.960743:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789776721.960769:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.960826:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876716449635712:12345-0@lo:400:kworker.0 Request processed in 68us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776721.960894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876716449635968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776721.961264:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449635456 00000100:00100000:2.0:1789776721.961270:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449635456 00000100:00100000:0.0:1789776721.961348:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449636096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789776721.961384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776721.961431:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716449636096 00000100:00100000:0.0:1789776721.961435:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716449636096 00000100:00100000:0.0:1789776721.961462:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776721.961468:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449636096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789776721.961483:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789776721.961549:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876716449636096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776721.961567:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776721.964782:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776721.964811:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449635584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.964979:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876716449635584:12345-0@lo:400:kworker.0 Request processed in 184us (7990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776721.964987:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776721.965165:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cff492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876716449636096:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789776721.965181:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5cf089df80 x1876716449635584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776721.965403:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876716449635584:0@lo:400:kworker.0 00000100:00080000:1.0:1789776721.965479:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776721.965548:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876716449634688:0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.965560:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876716449635200:0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.965595:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876716449635712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.965606:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:086c90d1-9383-41b8-afea-b47b6abf291d:3644:1876716449634304:0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.965629:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876716449634816:0@lo:400:kworker.0 00000100:00100000:1.0:1789776721.965642:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876716449635328:0@lo:400:kworker.0 00010000:00080000:1.0:1789776721.965670:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a5bc3479f80 x1876716449635840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776721.965679:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5bc3479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876716449635840:0@lo:400:kworker.0 00000100:00100000:3.0:1789776721.966536:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776721.966710:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776721.966724:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449635456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776721.966803:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876716449635456:12345-0@lo:400:kworker.0 Request processed in 84us (7714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776721.966810:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776721.966829:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a5cf089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876716449635456:0@lo:400:kworker.0 00000040:00080000:2.0:1789776722.596184:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776722.596193:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776722.596212:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789776722.596231:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789776722.981202:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776723.135548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135584:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135880:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.135979:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1789776723.136008:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795136 00000100:00100000:3.0:1789776723.136017:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795136 00000100:00100000:3.0:1789776723.136077:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:3.0:1789776723.136086:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2411:x1876716432795136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.136157:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc2107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b16530f-c033-42a8-8d5b-836bd948ad72+13:2411:x1876716432795136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 72us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.136165:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:3.0:1789776723.136196:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795392 00000100:00100000:3.0:1789776723.136200:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795392 00000100:00100000:3.0:1789776723.136248:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795904 00000100:00100000:3.0:1789776723.136251:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795904 00000100:00100000:3.0:1789776723.136264:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795264 00000100:00100000:3.0:1789776723.136266:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795264 00000100:00100000:3.0:1789776723.136278:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795776 00000100:00100000:3.0:1789776723.136279:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795776 00000100:00100000:3.0:1789776723.136294:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:3.0:1789776723.136299:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.136330:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cfc396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.136347:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:3.0:1789776723.136361:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776723.136367:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432795904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.136397:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432795904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.136404:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1789776723.138788:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:3.0:1789776723.138807:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:2411:x1876716432795264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.138899:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46b2d271-3290-4278-a9ba-b0b58b3db4ff+22:2411:x1876716432795264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 97us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.138907:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:3.0:1789776723.138924:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776723.138932:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432795776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.138962:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+6:2411:x1876716432795776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.138968:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1789776723.138993:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795648 00000100:00100000:3.0:1789776723.139000:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795648 00000100:00100000:3.0:1789776723.139045:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432796160 00000100:00100000:3.0:1789776723.139049:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432796160 00000100:00100000:3.0:1789776723.139063:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432795520 00000100:00100000:3.0:1789776723.139065:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432795520 00000100:00100000:3.0:1789776723.139076:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716432796032 00000100:00100000:3.0:1789776723.139079:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716432796032 00000100:00100000:3.0:1789776723.139094:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1789776723.139110:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.139137:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.139143:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1789776723.139154:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1789776723.139160:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432796160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.139183:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432796160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.139189:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1789776723.139200:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1789776723.139226:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.139252:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5bc3d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46b2d271-3290-4278-a9ba-b0b58b3db4ff+5:2411:x1876716432795520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 46us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.139258:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1789776723.139269:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1789776723.139275:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432796032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1789776723.139293:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a5cd8826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61ebe720-9c2b-4296-9269-a6a3ff3a08d8+5:2411:x1876716432796032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 19us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776723.139298:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00080000:3.0:1789776723.139487:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776723.139518:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776723.139521:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776723.139523:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 Debug log: 41583 lines, 41583 kept, 0 dropped, 0 bad.